Lead Data Engineer

Hybrid in Madison, WI, US • Posted 2 hours ago • Updated 2 hours ago
Full Time
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Agile
  • Analytics
  • Artificial Intelligence
  • Cloud Computing
  • Collaboration
  • Communication
  • Computer Science
  • Continuous Delivery
  • Continuous Improvement
  • Continuous Integration
  • Data Engineering
  • Data Governance
  • Data Lake
  • Data Modeling
  • Data Processing
  • Data Quality
  • Data Science
  • Data Warehouse
  • Databricks
  • DevOps
  • Development Testing
  • ELT
  • Extract
  • Transform
  • Load
  • Git
  • Good Clinical Practice
  • Google Cloud
  • Google Cloud Platform
  • Information Systems
  • Machine Learning (ML)
  • Modeling
  • Offshoring
  • Performance Tuning
  • Python
  • Real-time
  • Regulatory Compliance
  • Reporting
  • SQL
  • STaaS
  • Snow Flake Schema
  • Software Design
  • Sprint
  • Stakeholder Management
  • Unstructured Data

Summary

ONLY W2, NO C2C
Lead Data Engineer
Hybrid Madison, WI (LOCALS ONLY)
6+ Months CONTRACT TO HIRE
INTERVIEW TYPE 2 Rounds

Data Engineering & Platform Development
Design and build robust batch and real-time data pipelines using Google Cloud Platform technologies.
Develop scalable data ingestion frameworks capable of processing large volumes of structured and unstructured data.
Build and maintain cloud-native solutions that support analytics, AI/ML, and operational reporting.
Optimize data processing performance, reliability, and cost efficiency across cloud environments.
Partner with Data Science and Analytics teams to enable advanced modeling and machine learning initiatives.

Cloud & Data Architecture
Lead the implementation of modern cloud data architectures utilizing:
BigQuery
Dataflow
Dataproc
Cloud Composer
Pub/Sub
Cloud Storage
Cloud Functions
Design data lake, data warehouse, and data product solutions that support enterprise business needs.
Implement monitoring, observability, data quality, lineage, and governance best practices.

Agile Delivery
Participate in sprint planning, backlog refinement, and solution design sessions.
Collaborate with distributed teams, including offshore engineering resources.
Drive continuous improvement across development, testing, deployment, and support processes.

Required Qualifications
Bachelor's Degree in Computer Science, Engineering, Information Systems, or related field.
8-10+ years of Data Engineering experience.
3+ years in a Lead, Principal, or Senior Data Engineering capacity.
Expert-level proficiency with Python for data engineering and data processing.
Strong hands-on experience with Google Cloud Platform (Google Cloud Platform).
Extensive experience with:
BigQuery
Dataflow
Dataproc / PySpark
Cloud Composer (Airflow)
Pub/Sub
Cloud Storage
Strong SQL development and data modeling experience.
Experience building enterprise-scale ETL/ELT pipelines.
Experience working with large-volume datasets and performance optimization.
Knowledge of CI/CD, Git, DevOps practices, and automated deployment frameworks.
Strong communication and stakeholder management skills.
Ability to work independently and lead technical initiatives from concept through production.

Preferred Qualifications
Experience with Snowflake, Databricks, or modern lakehouse architectures.
Experience enabling AI/ML workloads and feature engineering pipelines.
Knowledge of data governance, data quality frameworks, and regulatory compliance requirements.
Experience working within large enterprise Agile environments.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10113363
  • Position Id: 9110323
  • Posted 2 hours ago
Contact the job poster
Abhishek Sharma

Abhishek Sharma

Senior Recruiter @ Innovative Information Technologies, Inc
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Madison, Wisconsin

•

Today

Easy Apply

Full-time

$60 - $70 per hour

Madison, Wisconsin

•

2d ago

Easy Apply

Contract, Third Party

Depends on Experience

No location provided

•

Today

Full-time

USD 113,100.00 - 178,900.00 per year

No location provided

•

Today

Full-time

Search all similar jobs