Sr. Data Engineer

Hybrid in Parsippany-Troy Hills, NJ, US • Posted 1 day ago • Updated 1 day ago
Contract Corp To Corp
Contract W2
Contract Independent
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

  • DATA ENGINEER
  • PYTHON
  • AWS
  • DYNAMODB
  • PIPELINES
  • PYSPARK
  • DATABRICKS

Summary

We are looking for a highly skilled Data Engineer with deep hands‐on experience in Python, PySpark, Databricks, and DynamoDB to help build and optimize modern data pipelines at scale. This role is ideal for someone who excels in high‐performance data engineering, thrives in a collaborative environment, and can leverage emerging AI tools (such as Copilot) to improve delivery speed and code quality.

Required Qualifications
  • 8+ years of professional experience in data engineering or related field.
  • Strong proficiency in:
  • Python
  • PySpark
  • Databricks (Delta Lake, notebooks, jobs, cluster management)
  • Hands‐on experience with AWS DynamoDB in production environments.
  • Experience building scalable data pipelines for ingestion, transformation, and retrieval.
  • Strong understanding of DataFrame optimizations, performance tuning, and distributed computing best practices.
  • Familiarity with GitHub, JIRA, and Confluence for version control and team collaboration.
  • Strong communication skills and ability to partner with both technical and business stakeholders.

Nice to Have
  • Experience using AI-assisted coding tools such as GitHub Copilot, Amazon Q, or similar LLM-based development accelerators.
  • Exposure to AWS services beyond DynamoDB (S3, Lambda, Glue, EMR, etc.), though not required.
  • Familiarity with CI/CD tools such as Jenkins or infrastructure-as-code tools like Terraform.
  • Experience with monitoring tools (Splunk, Dynatrace), though these are not primary requirements.
  •  
  • Key Responsibilities
  • Design, develop, and maintain data ingestion and transformation pipelines using Python, PySpark, and Databricks.
  • Build and optimize workflows for reliable, scalable, and performant data processing.
  • Work with AWS DynamoDB for production use cases involving NoSQL storage and retrieval.
  • Collaborate closely with cross‐functional partners (engineering, product, analytics) to translate business needs into technical solutions.
  • Leverage AI developer tools (e.g., GitHub Copilot, Amazon Q) to accelerate development, improve code quality, and support team productivity.
  • Ensure high standards for data quality, documentation, testing, and maintainability.
  • Participate in code reviews, design sessions, and continuous improvement efforts.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91132164
  • Position Id: 26-00084
  • Posted 1 day ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Hybrid in Newark, New Jersey

Today

Easy Apply

Full-time

Depends on Experience

Remote or New York, New York

Today

Full-time

USD 144,768.00 - 209,109.33 per year

Hybrid in Bernards, New Jersey

2d ago

Easy Apply

Third Party, Contract

Depends on Experience

Hybrid in Bernards, New Jersey

2d ago

Easy Apply

Third Party, Contract

Depends on Experience

Search all similar jobs