Lead Data Engineer

Overview

On Site
Depends on Experience
Full Time
50% Travel

Skills

ADF
Amazon Web Services
Analytics
Apache Kafka
Apache Spark
Banking
Cloud Computing
Communication
Conflict Resolution
Continuous Delivery
Continuous Integration
Data Engineering
Data Profiling
Data Quality
Data Warehouse
Databricks
DevOps
Documentation
ELT
Extract
Transform
Load
Finance
Git
IT Management
Java
Jenkins
Leadership
Machine Learning (ML)
Master Data Management
Mentorship
Microservices
Microsoft
Microsoft Azure
Microsoft Power BI
Microsoft SSIS
Mobile Device Management
Optimization
Performance Monitoring
Problem Solving
Python
Scala
Snow Flake Schema
Software Design
Streaming
Tableau
Testing
Unstructured Data

Job Details

Job Title: Data Engineering Lead / Solution Architect

Location: Jefferson City, MO
Type: Contract-to-Hire (9 12 months)
Banking Domain

Summary:

Seeking a Data Engineering Lead/Solution Architect with strong banking experience and hands-on expertise in Microsoft data services (Azure Fabric, ADF, Synapse), ETL/ELT, and cloud modernization. The ideal candidate will lead and mentor data engineering teams, drive data modernization initiatives, and design scalable cloud data solutions.

Key Responsibilities:

  • Lead modernization of legacy ETL/ELT and data systems to cloud (Azure/AWS).

  • Design and maintain cloud-based data pipelines and architectures.

  • Mentor data engineers; provide technical leadership and solution guidance.

  • Work closely with stakeholders to translate business needs into scalable data solutions.

  • Implement security, classification, and regulatory data standards (PII, sensitive data).

  • Perform data profiling, integration, and optimization across structured/unstructured data.

  • Build/automate ETL/ELT using Databricks, ADF, SSIS, Spark, Python/Scala.

  • Conduct testing, documentation, and performance monitoring of data pipelines.

Required Skills:

  • 3+ years in data warehouse/analytics solution design (on-prem & cloud).

  • Strong experience with ADF, Synapse, SSIS, ETL/ELT, data quality, MDM.

  • Cloud experience with Azure data services (Fabric Lakehouse, ADF, Synapse).

  • 2+ years in Python/Scala/Java for distributed processing (Spark).

  • Knowledge of CI/CD (Azure DevOps, Git, Jenkins).

  • Strong communication, leadership, and problem-solving skills.

Nice to Have:

  • Experience with Snowflake, Databricks, AWS.

  • Knowledge of microservices, containerization, Kafka/event streaming.

  • Microsoft Purview, Power BI/Tableau.

  • Banking/financial sector experience.

  • Familiarity with ML concepts.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.