Data Engineer

Overview

On Site
$70 - $85 hr
Contract - W2
Contract - Independent

Skills

Sensors
Extract
Transform
Load
ELT
Storage
Time Series
Mentorship
Technical Drafting
Workflow
Data Engineering
Software Development
Python
Performance Tuning
Data Processing
Apache Spark
PySpark
Scala
Cloud Computing
Amazon Web Services
Microsoft Azure
Google Cloud
Google Cloud Platform
Data Storage
IoT
MDF
Databricks
Unity
Continuous Integration
Continuous Delivery
Data Quality
Layout
Hue
Legal
Insurance

Job Details

Data Engineer
Contract (6 Months + Possible Extension)
Austin, TX (Onsite)

Pay Rate: $70-75 an hour on W2

Key Responsibilities:

  • Design and build robust data pipelines in Python to extract, transform, and load data from MF4/MDF4 files (e.g., automotive telemetry and sensor logs).
  • Architect scalable ETL/ELT workflows in Databricks, leveraging Delta Lake and cloud-native storage solutions.
  • Optimize performance and ensure reliability of pipelines handling large-scale, high-frequency time-series datasets.
  • Mentor junior engineers and contribute to technical design reviews, architecture discussions, and code quality initiatives.
  • Stay current with industry trends in data engineering, Lakehouse architecture, and modern data workflows.
Required Qualifications:
  • 5+ years of experience in data engineering and software development.
  • Advanced proficiency in Python, including performance tuning and large-scale data processing.
  • Strong experience with Databricks, Delta Lake, and Spark (PySpark or Scala).
  • Proven ability to design and implement high-throughput, fault-tolerant pipelines in production environments.
  • Familiarity with cloud platforms (AWS, Azure, or Google Cloud Platform), including data storage, compute, and security best practices.
Preferred Qualifications:
  • Experience in automotive, IoT, or telemetry-intensive industries.
  • Hands-on experience parsing and processing MF4/MDF4 files (ASAM standards).
  • Exposure to Databricks Unity Catalog and Delta Live Tables.
  • Understanding of GitOps practices and CI/CD pipelines.
#LI-SJ3

Benefits via Pride Global

Eligible employees receive:

  • Medical, dental, and vision insurance
  • 401(k) retirement savings
  • Life and disability insurance
  • Accident & critical illness coverage
  • Legal and employee assistance programs (EAP)
  • Pet, auto, and home insurance
  • Discounts with preferred vendors
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.