Job Title: Data Engineer
Location: Madison, WI, Columbus, OH, Chicago, IL, Minneapolis, MN, Detroit, MI.
Long Term Contact
Looking for W2 candidates. No C2C
Job Summary:
We are looking for a skilled Data Engineer to join our team . The ideal candidate will have strong experience in PySpark, Microsoft Azure, Azure Data Factory (ADF), SQL, and Data Warehousing. This role focuses on designing scalable data pipelines, building enterprise ETL/ELT solutions, and delivering high-quality data integration across cloud-based platforms.
Key Responsibilities:
• Design, develop, and optimize scalable data pipelines.
• Build, maintain, and enhance ETL/ELT workflows using Azure Data Factory (ADF).
• Process, transform, and optimize large datasets using PySpark.
• Develop efficient data integration solutions across multiple enterprise systems.
• Create scalable and reliable cloud-based data engineering solutions on Microsoft Azure.
• Optimize SQL queries, data warehouse performance, and data processing workflows.
• Ensure data quality, reliability, consistency, and governance.
• Troubleshoot production issues and optimize pipeline performance.
• Collaborate with cross-functional teams including business analysts, data scientists, and application developers.
• Support continuous improvements in data architecture and engineering best practices.
Required Skills:
• Strong experience in PySpark.
• Hands-on experience with Microsoft Azure.
• Expertise in Azure Data Factory (ADF).
• Strong knowledge of ETL/ELT development.
• Experience designing scalable data pipelines.
• Strong SQL programming and database optimization skills.
• Experience with Data Warehousing concepts and implementation.
• Experience in data integration and performance tuning.
• Knowledge of cloud-based data engineering best practice.
Preferred Skills:
• Experience with Azure Databricks.
• Knowledge of Delta Lake, Spark SQL, and Azure Synapse Analytics.
• Familiarity with CI/CD pipelines and DevOps practices.
• Experience working in Agile/Scrum environments.
Best Regards:
Bindu M
Phone: 307–298-2022
Email:
Never miss an opportunity! Create an alert based on the job you applied for.