Apply Now

Data Engineer (Databricks Certified)

Hybrid in Boston, MA, US • Posted 14 hours ago • Updated 14 hours ago

Contract Independent

Contract W2

No Travel Required

Hybrid

Depends on Experience

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

Workflow
Google Cloud Platform
Machine Learning (ML)
Extract, Transform, Load
Good Clinical Practice
Databricks
DevOps
ELT
Data Processing
Data Quality
Data Warehouse
Data Architecture
Data Engineering
Continuous Delivery
Continuous Integration
Collaboration
Computer Science
Apache Spark
Cloud Computing
Data Modeling
Amazon Web Services
Apache Kafka
Unstructured Data
PySpark
SQL
Big Data
Microsoft Azure
Orchestration
Scala
Streaming

Summary

Key Responsibilities

• Design and develop scalable data pipelines using Databricks (Delta Lake, Spark)

• Build and maintain ETL/ELT workflows for large-scale data processing

• Optimize data architecture for performance, reliability, and cost-efficiency

• Work with structured and unstructured data from multiple sources

• Collaborate with data scientists, analysts, and business stakeholders

• Implement data quality, validation, and governance frameworks

• Troubleshoot and resolve data pipeline and performance issues

Required Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or related field

• Databricks Certification (Associate or Professional level) – required

• 3+ years of experience in data engineering or related roles

• Strong experience with:

• Apache Spark (PySpark/Scala)

• Databricks platform

• SQL and data modeling

• Experience with cloud platforms (AWS, Azure, or Google Cloud Platform)

• Knowledge of data warehousing concepts and big data technologies

Preferred Qualifications:

• Experience with Delta Lake and Lakehouse architecture

• Familiarity with workflow orchestration tools (Airflow, Azure Data Factory)

• Experience with streaming data (Kafka, Spark Streaming)

• Knowledge of CI/CD pipelines and DevOps practices

• Exposure to machine learning pipelines is a plus

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91098321
Position Id: 8934830
Posted 14 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Sr. Databricks Lead/Architect

Boston, Massachusetts

•

Today

Solution IT Inc. is looking for Sr. Databricks Lead/Architect one of its clients - Boston, MA Job Title: Sr. Databricks Lead/Architect Responsibilities: Customer & Stakeholder Engagement Act as the primary technical point of contact for customer stakeholders (Business, Product Owners, Architects, and IT Leadership). Lead requirements discovery workshops, solution discussions, and architecture reviews. Translate business requirements into scalable Azure Databricks based data architectures. Pre

Easy Apply

Full-time, Contract, Third Party

Sr Big Data Engineer

Quincy, Massachusetts

•

Yesterday

Title: Sr Big Data Eng. Location: Quincy, MA (Onsite) Position: Contract Note: A face-to-face interview is a must for the final round Required: Overall experience of 7 to 8 years in Scala-Spark data engineering and Data pipeline design Experience in data bricks Hands-on experience in the design and development of the ingestion pipeline, ETL pipeline, and jobs in Data Bricks. Data bricks workspace and cluster configuration, and Job scheduling and workflow management Hands-on experience in Scala-S

Easy Apply

Contract, Third Party

Depends on Experience

Senior Databricks Platform Administrator - Onsite - Boston, MA - Direct Client

Boston, Massachusetts

•

Yesterday

We are currently supporting a direct client that has recently migrated from a legacy data platform to Databricks as part of a broader modernization initiative. As this is a new implementation of their Lakehouse platform, the team is looking for a Senior Databricks Platform Administrator who can play a key role in guiding the platform through the next phase ? including POC validation, platform governance, and operational best practices. This role is ideal for someone who enjoys working at the arc

Easy Apply

Contract, Third Party

Big Data Developer

Hybrid in Boston, Massachusetts

•

Yesterday

[Big data developer Work Location Boston] (Inperson interview can be accommodated between Austin or MA office ) Overall experience 7 to 8 years in Scala-Spark data engineering and Data pipeline designExperience in databricks preferredHands on experience in Design and development of Ingestion pipeline, ETL pipeline and jobs in Databricks. Databricks workspace and cluster configuration and Job scheduling and workflow managementHands on experience in Scala-Spark Development

Easy Apply

Contract

$50 - $60

Search all similar jobs