Apply Now

Data Engineer

Hybrid in New York, NY, US • Posted 1 day ago • Updated 1 day ago

Contract W2

12 Months

No Travel Required

Hybrid

$50 - $60/yr

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Job Details

Skills

Data Bricks

Summary

Job Description

We are seeking a Databricks ETL Developer with hands-on experience in building scalable ETL pipelines using the Databricks platform. The ideal candidate should have strong expertise in Spark, SQL, Python, cloud data engineering, and modern data warehousing concepts. A Databricks Certification is highly preferred.

Required Skills

5+ years of experience in Data Engineering and ETL development.
Hands-on experience with Databricks and Apache Spark (PySpark).
Strong experience designing and developing ETL/ELT pipelines.
Expertise in Python, SQL, and Spark SQL.
Experience with Delta Lake, Unity Catalog, and Delta Live Tables (DLT).
Experience with Azure Databricks, AWS Databricks, or Databricks on Google Cloud Platform.
Knowledge of Data Lake, Data Warehouse, and Medallion Architecture.
Experience integrating data from relational databases, APIs, flat files, and cloud storage.
Strong understanding of data modeling, partitioning, optimization, and performance tuning.
Experience with orchestration tools such as Azure Data Factory (ADF), Apache Airflow, or similar.
Familiarity with Git, CI/CD pipelines, and Agile methodologies.
Excellent troubleshooting and analytical skills.

Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines using Databricks.
Process large-scale structured and unstructured datasets using PySpark.
Develop optimized Spark jobs for batch and incremental data processing.
Build and maintain Delta Lake tables for reliable data storage.
Perform data validation, cleansing, and transformation activities.
Optimize Databricks workloads for performance and cost efficiency.
Collaborate with Data Architects, Analysts, and Business teams to deliver data solutions.
Implement data quality checks and monitoring processes.
Support production deployments and resolve data pipeline issues.
Document ETL processes and technical designs.

Preferred Qualifications

Databricks Certified Data Engineer Associate or Databricks Certified Data Engineer Professional.
Experience with Azure Data Factory (ADF), Snowflake, Azure Synapse, or Microsoft Fabric.
Experience with Kafka, Event Hubs, or other streaming technologies.
Knowledge of Power BI, Tableau, or other BI tools.
Exposure to DevOps and Infrastructure as Code (Terraform) is a plus.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91141690
Position Id: 9044694
Posted 1 day ago

Contact the job poster

Jay Kumar

Recruiter @ SN Cloud Solutions

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Jersey City, New Jersey

•

Yesterday

Job Title: Data Engineer Location: Jersey City, NJ Job Description: Design, develop, and maintain scalable ETL/ELT pipelines. Build and optimize data models for reporting and analytics. Develop and maintain data warehouses and data lakes. Integrate data from multiple internal and external sources. Monitor data pipelines to ensure data quality, reliability, and performance. Implement data validation, cleansing, and transformation processes. Collaborate with cross-functional teams to unders

Easy Apply

Contract

40 - 45

DataBricks Data Engineer

New York, New York

•

Today

job summary: We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions using the Databricks platform to support data ingestion, transformation, performance reporting, analytics, sales incentive compensation processing, and enterprise data pipeline processes. location: New York, New York job type: Contract salary: $65.86 - 75.86 per hour work

Contract

USD66 - USD76

Data Engineer with DataBricks at New York, NY (HYBRID)

New York, New York

•

Today

Job Title: Data Engineer with DataBricks Location: New York, NY (HYBRID) Duration: 6+ Month's TAX TERMS : ONLY W2. Job Description Responsibilities: Collaborate with business stakeholders to understand their data requirements and translate them into scalable technical solutions. Design and develop Databricks-based data pipelines, including data models, Delta Lake tables, and dashboards/notebooks. Responsible for the overall Databricks architecture to ensure new pipelines and enhancements to e

Easy Apply

Contract

Databricks Data Engineer

New York, New York

•

14d ago

Databricks Data EngineerWe are seeking an experienced Databricks Data Engineer to design, develop, and optimize scalable data solutions using the Databricks platform. The ideal candidate will build and maintain enterprise data pipelines, support analytics and reporting solutions, and work closely with business teams to deliver reliable data-driven solutions. Responsibilities:Develop and maintain Databricks-based data pipelines using Delta Lake, Delta Live Tables, and Workflows.Design and optimiz

Easy Apply

Contract

60 - 75

Search all similar jobs

More jobs at SN Cloud Solutions in New York, NY