Databricks Engineer / Remote / Contract

Remote in Remote, MA, US • Posted 8 hours ago • Updated 8 hours ago
Contract W2
On-site
Company Branding Image
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • FOCUS
  • Data Engineering
  • Data Integration
  • Database
  • Recovery
  • Version Control
  • Automated Testing
  • Reporting
  • Analytics
  • Solution Architecture
  • Data Flow
  • Automotive Manufacturing
  • IBM InfoSphere DataStage
  • PySpark
  • Databricks
  • Python
  • SQL
  • Apache Spark
  • GitHub
  • Continuous Integration
  • Continuous Delivery
  • Extract
  • Transform
  • Load
  • Data Quality
  • Testing
  • Production Support
  • Documentation
  • Mapping
  • Collaboration

Summary

We are working with a leading automotive manufacturing company seeking a Senior Integration Engineer for a fully remote contract opportunity in the United States. This role will focus on enterprise data integration and analytics using IBM DataStage, PySpark, Databricks, Python, SQL, and Delta Lake. The initial contract is three months, with renewals every three months.

This is an opportunity to work on enterprise-scale data integration initiatives, building reliable pipelines that connect applications and transform data into governed assets for reporting and analytics. The team is looking for a hands-on engineer who can develop, troubleshoot, and optimize production data pipelines while contributing to modern Databricks architecture, data quality, and automation practices. The role offers exposure to modern data engineering technologies within a large automotive manufacturing environment.

Contract Duration: 3 months, with renewals every 3 months

Required Skills & Experience
  • Hands-on experience with IBM DataStage and PySpark.
  • Strong Python and SQL development skills.
  • Experience designing, developing, and supporting ETL and data integration pipelines.
  • Experience with Databricks and data ingestion from multiple sources, including files, APIs, and databases.
  • Understanding of Bronze, Silver, and Gold data-layer architecture.
  • Experience with data transformations, incremental processing, schema enforcement, and data quality.
  • Experience troubleshooting production data pipelines and implementing error handling and recovery.
  • Familiarity with GitHub, version control, code reviews, and CI/CD practices.

Desired Skills & Experience
  • Experience with Delta Lake and Spark Declarative Pipelines.
  • Experience integrating data through enterprise transfer services such as Sterling.
  • Familiarity with automated testing, pipeline monitoring, and quarantine patterns.
  • Experience developing governed data products for reporting and analytics.
  • Ability to document solution architecture, data flows, dependencies, and source-to-target mappings.
  • Experience working in large enterprise or automotive manufacturing environments.

What You Will Be Doing

Tech Breakdown
  • 30% IBM DataStage and ETL development
  • 30% PySpark and Databricks
  • 20% Python and SQL transformations
  • 10% Delta Lake and Spark Declarative Pipelines
  • 10% GitHub, CI/CD, testing, and monitoring

Daily Responsibilities
  • 50% Hands-on development, data pipeline engineering, and troubleshooting
  • 20% Data quality, testing, deployment, and production support
  • 15% Architecture documentation and source-to-target mapping
  • 15% Team collaboration with project and platform teams
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10105282
  • Position Id: 892736
  • Posted 8 hours ago

Company Info

About Motion Recruitment Partners, LLC

Motion Recruitment delivers IT Talent Solutions for Contract, Direct Hire, Managed Solutions and Statement of Work to all of North America from our 21 delivery centers. Our high-touch, specialized, team-based recruitment model’s success is proven through our exemplary track record in filling the most challenging IT positions for startup and enterprise clients alike. Our hyper-specialized tech focus results in a truly consultative approach for both our clients and candidates, within our recruiting areas of expertise: Software, Mobile, Data, Infrastructure, Cybersecurity, Product + UX and Functional.

Motion also delivers IT Consulting Solutions through the Motion Consulting Group (MCG) that create true digital transformation for IT projects in Agile Development & Coaching, DevOps & DevSecOps Solutions, and Managed Services for IT Operations.

We’re also the proud creators of Tech in Motion and the Timmy Awards, our North American community platform, events series and award program that connects over 250,000 tech enthusiasts to meet, learn, and innovate.

About_Company_OneAbout_Company_Two
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.