Overview
Skills
Job Details
About DataAffect: We are a boutique data/service management firm specializing in the delivery of Data Governance, Enterprise Data Strategy, Solutions Architecture, Data Warehousing, Data Integrations, Data Security & Privacy Management, IT Service Management, Business analysis, and Agile Project Management services to diverse clients across multiple industries.
Role: Senior ETL DataStage Lead
Location: Detroit, Michigan (4 days onsite)
Duration: Long-term contract
About the Role:
We are seeking a highly experienced ETL Lead to design, lead, and optimize enterprise data integration workflows using IBM DataStage on Cloud Pak for Data (CP4D), AWS Glue & Lambda, and Snowflake. The ideal candidate will drive modern data transformation strategies for large-scale data ingestion pipelines supporting analytics, governance, and AI/ML workloads.
Required Qualifications
- 8+ years of enterprise data integration experience with at least 3+ years as a technical lead.
- Strong expertise in IBM DataStage, including modern deployments on Cloud Pak for Data (CP4D).
- Solid experience with AWS Glue (PySpark) and AWS Lambda for scalable, serverless data transformation.
- Proven knowledge of Snowflake data warehousing, including external stages, streams, tasks, and performance tuning.
- Experience with complex ETL orchestration involving parallel processing, dynamic parameterization, and error handling.
- Strong SQL, Python (preferred for Glue), and performance tuning skills.
- Understanding of data lakehouse architectures, S3, and ingestion patterns (batch/real-time).
- Familiarity with data governance and lineage tools (e.g., Collibra, BigID, Manta).
- Knowledge of CI/CD, Git, Jenkins, and code promotion strategies.
- Strong verbal and written communication skills; experience working in agile/scrum delivery model.