Senior Data Engineer

Remote • Posted 2 hours ago • Updated 40 minutes ago

Contract Corp To Corp

Contract W2

Remote

$DOE

Fitment

Dice Job Match Score™

📊 Calculating match score...

Job Details

Skills

Senior Data Engineer

Summary

HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for Senior Data Engineer in Remote. Below is the detailed job description.

Job Title: Senior Data Engineer

Location: Remote- Canada, USA, and Latin America

Role Overview

We are seeking a hands-on Senior Data Engineer with strong expertise in Databricks, Spark/PySpark, and SQL to build and scale production-grade data pipelines. This is a coding-intensive role requiring daily hands-on development-not a design-only position.

You will work closely with Data Architects and client stakeholders to translate data contracts and business rules into robust, scalable pipelines, with a strong focus on data quality, identity resolution, and performance optimization.

Key Responsibilities

Develop production-grade Spark/PySpark and SQL pipelines in Databricks on a daily basis
Partner with Data Architects to translate stitching rules and data contracts into scalable implementations
Own the end-to-end data pipeline lifecycle:
- Data profiling
- Ingestion
- Transformation
- Validation
- Deployment & monitoring
Build and maintain:
- Match-rate validation frameworks
- Deduplication audits
- Data quality dashboards
Collaborate with client teams to define and source customer universe data (transactions, stores, regions, etc.)
Participate in phase gate reviews and present progress to internal and client stakeholders
Create and maintain technical documentation including data contracts, lineage, and runbooks

Required Qualifications

5+ years of experience in data engineering, building scalable production pipelines
Strong hands-on expertise with Databricks and Apache Spark (PySpark or Scala)
Advanced SQL skills including complex joins, window functions, CTEs, and performance tuning
Experience with identity resolution / entity matching pipelines (deterministic or probabilistic)
Strong understanding of data modeling (Kimball or similar dimensional modeling)
Experience implementing data quality frameworks (schema drift, validation, anomaly detection)
Experience with CI/CD pipelines and multi-environment deployments (dev/staging/prod)
Strong communication skills; ability to explain technical concepts to non-technical stakeholders
Hands-on experience with Jira (ticketing) and Confluence (documentation)

Preferred Qualifications

Experience with 3rd-party data platforms such as Epsilon, LiveRamp, or Neustar
Familiarity with feature stores (Feast, Databricks Feature Store, etc.)
Experience with Databricks Unity Catalog
Experience working with customer data domains (transactions, loyalty, CRM), preferably in Retail or QSR
Hands-on experience with Delta Lake / Lakehouse architecture
Familiarity with orchestration tools such as Airflow or Databricks Workflows
Experience working in a consulting or client-facing environment

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10481867
Position Id: 2026-17836
Posted 2 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Data Engineer

Remote or Philadelphia, Pennsylvania

•

Today

Description Overview We are seeking a Senior Data Engineer to support a major Salesforce Phase 2 data migration initiative. This role will focus heavily on building and optimizing data pipelines, developing ETL workflows, and moving CRM data from Salesforce into Databricks. The engineer will work closely with a senior team member, contribute to Scrum ceremonies, and play a key role in developing the core CRM data environment used by the advertising organization. Key Responsibilities Data Eng

Easy Apply

Contract

USD 56.00 - 65.00 per hour

Senior Data Engineer

Remote

•

14d ago

Job OverviewWe are seeking an experienced Data Engineer to design, build, and maintain scalable data infrastructure that supports analytics, machine learning, and business intelligence initiatives. The Data Engineer will work closely with data scientists, analysts, and software engineers to ensure reliable data pipelines and high-quality data availability across the organization. The ideal candidate will have strong experience in data pipeline development, big data processing frameworks, and clo

Contract

60 - 70

Senior Data Engineer

Remote

•

15d ago

We are looking for a highly skilled Data Engineer to design, build, and maintain scalable data platforms on AWS. The ideal candidate is hands-on, cloud-native, and strong in Python, SQL, PySpark, AWS Glue, and Terraform, with experience building production-grade data pipelines. Responsibilities:Design, develop, and maintain scalable data pipelines using AWS services Build and optimize ETL/ELT pipelines using PySpark and AWS Glue Develop clean, efficient, and reusable code using Python Write and

Easy Apply

Contract

$60 - $70

Senior Data Engineer

Remote

•

Today

Pay Range: $60- $85/hr. The pay rate may differ depending on your skills, education, experience, and other qualifications. Featured Benefits: Medical Insurance in compliance with the ACA.401(k).Sick leave in compliance with applicable state, federal, and local laws.Profile: Senior Data Engineer with SME in data analytics end AI work within our tech stack; 5+ years of experience. Responsibilities: Collaborate with and across Agile teams to design, develop, test, implement, and support technical s

Easy Apply

Contract

60 - 85

Search all similar jobs