Apply Now

Senior Data Engineer

New York, NY, US • Posted 1 day ago • Updated 11 hours ago

Full Time

On-site

USD $150,000.00 - 180,000.00 per year

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Snow Flake Schema
Microsoft SQL Server
Cloud Computing
Onboarding
Data Validation
Data Warehouse
Collaboration
Databricks
Management
Microsoft Azure
Object-Oriented Programming
Python
Information Security Governance
Change Data Capture
Data Quality
Git
Workflow
Continuous Integration
Continuous Delivery
GitHub
Database Design
Optimization
Performance Tuning
Normalization
Data Compression
Data Integrity
Database
Orchestration
Communication
Finance
Reference Data
Dashboard
Reporting
Tableau

Snow Flake Schema
Microsoft SQL Server
Cloud Computing
Onboarding
Data Validation
Data Warehouse
Collaboration
Databricks
Management
Microsoft Azure
Object-Oriented Programming
Python
Information Security Governance
Change Data Capture
Data Quality
Git
Workflow
Continuous Integration
Continuous Delivery
GitHub
Database Design
Optimization
Performance Tuning
Normalization
Data Compression
Data Integrity
Database
Orchestration
Communication
Finance
Reference Data
Dashboard
Reporting
Tableau

Summary

Position overview

We are seeking a skilled Data Engineer with experience in Databricks, Snowflake, SQL Server, and cloud technologies. In this role, you will support and manage the organization's data environment, ensuring reliable data availability and quality. You will serve as a central point of contact for data projects and requests across the organization. The ideal candidate is an independent problem solver with strong communication skills and the ability to work effectively in a rapidly changing environment. The estimated salary range for this position is USD 150,000 to 180,000 per year. This role involves four in-office days per week.

Responsibilities

Manage Databricks instances, including onboarding datasets, permissions, security, and governance.
Set up centralized, automated pipelines to import various data sources into the data warehouse.
Set up automated processes for data refreshes, data validation, and monitoring in the data warehouse.
Manage day-to-day reporting and data requests.
Collaborate on data policy and governance.
Ensure data quality and easy data availability for end users.
Be the central point of contact for organization-wide data requests and projects.

Requirements

3+ years of strong experience in Databricks management.
3+ years of experience working with integrated services on Azure.
3+ years of experience with object-oriented programming in Python.
1+ year of experience with agentic coding assistants.
Strong experience in pipeline creation, security, governance, and Change Data Capture (CDC).
Demonstrated ability to independently diagnose and resolve pipeline and data quality issues.
Experience integrating and ingesting data from external APIs.
Experience deploying production-ready data assets with minimal oversight.
Experience with Git-based workflows and CI/CD (e.g., GitHub Actions).
Experience designing data monitoring and validation frameworks.
Proficiency in database design, optimization, and performance tuning.
Experience in data normalization and compression techniques to optimize data size and performance.
Ensure data integrity, security, and performance in the modernized database environment.
Should be comfortable working in a rapidly changing environment with ambiguous requirements.
Familiarity with orchestration tools.
Strong communication and interpersonal skills, with the ability to communicate with business users.
Must be able to work independently with minimal guidance.
Experience with financial data, such as trade data, reference data, position data, etc., to build functional calculation modules, reports, and dashboards.
Familiarity with reporting tools such as Tableau and Sigma is preferred.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: RTX19d967
Position Id: 259652b2b6e8b1e5639462d759f7b3c1
Posted 1 day ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Lead Data Architect - Databricks & AWS

New York, New York

•

Today

Software Guidance & Assistance, Inc., (SGA), is searching for a Lead Data Architect - Databricks & AWS for a Contract assignment with one of our premier Financial Services clients in New York, NY. Responsibilities : Architect scalable data processing frameworks leveraging Databricks platform for analytical workloads Implement cost-optimization strategies balancing compute resources, storage tiering, and cluster configurations Develop and maintain coding standards for PySpark/Python within Dat

Contract

Databricks Platform Manager/Engineer

Hybrid in New York, New York

•

Today

Job Title:Databricks Platform Manager/EngineerLocation: NY (Hybrid Onsite)Type: ContractJob SummaryWe are looking for aDatabricks Platform Manager/Engineerwith strong hands-on experience administering enterprise Databricks environments on AWS. The role focuses on platform administration, workspace and cluster management, Unity Catalog, AWS IAM, security/governance, Terraform/IaC, CI/CD, monitoring, and cost optimization. Ideal candidates will have 35+ years of production Databricks platform admi

Easy Apply

Full-time

50 - 55

Databricks Architect(New jersey,NJ)

Jersey City, New Jersey

•

Today

Job Title: Databricks Architect (Enterprise Data Platform) Experience: 10+ Years Location- NJ, Hybrid C2H after 3-6 months - We are seeking a highly skilled Databricks Architect to lead the design and implementation of next-generation data platforms built on the Lakehouse paradigm. This role goes beyond pipeline development-you will own the Databricks platform architecture end-to-end, driving scalability, governance, performance, and cost optimization across enterprise data ecosystems. Databr

Easy Apply

Full-time, Part-time, Contract, Third Party

Data Engineer - Capital Markets

New York, New York

•

Today

SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 employees worldwide in nearly 40 countries. Sumitomo Mitsui Financial Group, Inc. (SMFG) is the holding company of SMBC Group, which is one of the three largest banking groups in Japan. SMFG's shares trade on the Tokyo,

Full-time

USD 97,000.00 - 156,000.00 per year

Search all similar jobs

More jobs at DataArt Solutions in New York, NY