Senior Data Engineer (Databricks, AWS)

Overview

Hybrid
$80 - $90
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Data Engineering
Databricks
AWS
Azure
Data Modeling
Extract
Transform
Load
ELT
Python
PySpark
Real-time
Streaming
Problem Solving
NoSQL
RDBMS
Cloud Computing
Analytics
JSON
Data Quality
Meta-data Management

Job Details

** This requires ONSITE interview - NJ office **

Senior Data Engineer

We are looking for a Senior Data Engineer who will play a significant role in the creation and rollout of a centralized data hub that supplies refined client-service data at an enterprise level. This is a hands-on role focused on building scalable data pipelines, shaping enterprise data models, and enabling analysts, data scientists, applications, and business units to access high-quality, trusted data.

Key Responsibilities

  • Lead the architecture and development of a service data hub supporting enterprise-wide consumption.
  • Build and maintain scalable data pipelines primarily in Databricks for both structured and unstructured data.
  • Develop enterprise data models for data lakes, warehouses, and analytics solutions.
  • Define and implement data ingestion strategies (APIs, streaming, batch, replication).
  • Conduct source data analysis and ensure data quality, governance, lineage, and metadata.
  • Collaborate with source system owners, architects, and engineering teams across the organization.
  • Mentor developers and contribute to best practices for data engineering.
  • Support internal business units with standardized, consumption-ready service data.

Required Experience

  • 8+ years in data engineering, including proven hands-on experience with Databricks.
  • Hands-on experience building enterprise data lakes and pipelines
  • Strong AWS expertise; Azure experience a plus.
  • Proficiency in Python, SQL, PySpark, and cloud-native ETL/ELT frameworks.
  • Strong understanding of data modeling, data lakes, streaming, APIs, JSON, and real-time ingestion.
  • Experience with RDBMS (Oracle, SQL Server) and familiarity with NoSQL (MongoDB).
  • Hands-on experience with GitHub, JIRA, Confluence, CI/CD, Terraform, and Jenkins.
  • Strong communication, problem-solving, and analytical skills.
  • Strong troubleshooting ability and experience supporting multiple business units.
  • Relevant certifications preferred
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.