Data Engineer

Remote in CT, US β€’ Posted 1 hour ago β€’ Updated 1 hour ago
Contract W2
Remote
Fitment

Dice Job Match Scoreβ„’

πŸ”’ Crunching numbers...

Job Details

Skills

  • Microsoft Azure
  • cloud computing
  • API Management
  • Databricks
  • pyspark
  • Data Integration
  • Apache Kafka
  • Amazon Web Services
  • data pipelines
  • Digital Products
  • Data Streaming
  • Python (Programming Language)
  • Design Development
  • Engineering Design Process
  • Kinesiology
  • Data Mesh

Summary

Data Engineer

Connecticut (Remote)

Contract - 1 Year

Job Description:

  • Review and translate requirements to end-end technical design with a goal of building data products
  • Develop pipelines in Databricks using PySpark and DBT to onboard various sources
  • Working knowledge in Kafka to stream the data into databricks platform
  • Identify Common approaches and best practices to data integration such as metadata drive ingestion, data validations, complex data type handling
  • Drive standards for reusability, while developing pipelines
  • Create or update documentation associated to key decisions on requirements, design and development
  • Liaise with architects, data owners and users for reviews on day-day basis to ensure the quality of deliverables are high.

Skill Proficiency Requirements:

  • 8+ years of overall IT experience with 6 years as a Data Engineer
  • Experience in providing data engineering solutions
  • Working knowledge of below technology toolsets:
    • Cloud (Azure/AWS)
    • Databricks, Data Mesh, Data as a Product
    • Python
    • Data streaming (Kafka, EventHub, Kinesis, SNS)
    • Cloud-based API management good to have
    • Immuta good to have
  • Multi-cloud and on-prem application integration good to have
Employers have access to artificial intelligence language tools (β€œAI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10421780
  • Position Id: 2026-65457
  • Posted 1 hour ago
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.