Overview
On Site
100
Contract - W2
Contract - 6 Month(s)
No Travel Required
Unable to Provide Sponsorship
Skills
.NET
Amazon Redshift
Amazon Web Services
Apache Hadoop
Apache Hive
Apache Kafka
Apache Spark
Artificial Intelligence
Cloud Computing
Big Data
Data Governance
Data Engineering
Extract, Transform, Load
ELT
Job Details
The ideal candidate will have a proven track record of delivering end-to-end ETL/ELT pipelines across Databricks, Azure, and AWS environments.
Key Responsibilities
• Design scalable data lake and data architectures using Databricks and cloud-native services.
• Develop metadata-driven, parameterized ingestion frameworks and multi-layer data architectures.
• Optimize data workloads and performance.
• Define data governance frameworks for CHP.
• Design and develop robust data pipelines.
• Architect AI systems, including RAG workflows and prompt engineering.
• Lead cloud migration initiatives from legacy systems to modern data platforms.
• Provide architectural guidance, best practices, and technical leadership across teams.
• Build documentation, reusable modules, and standardized patterns.
Required Skills and Experience
• Strong expertise in cloud platforms, primarily Azure or AWS.
• Hands-on experience with Databricks.
• Deep proficiency in Python and SQL.
• Expertise in building ETL/ELT pipelines and ADF workflows.
• Experience architecting data lakes and implementing data governance frameworks.
• Hands-on experience with CI/CD, DevOps, and Git-based development.
• Ability to translate business requirements into technical architecture.
Technical Expertise
Programming: Python, SQL, R
Big Data: Hadoop, Spark, Kafka, Hive
Cloud Platforms: Azure (ADF, Databricks, Azure OpenAI), AWS
Data Warehousing: Redshift, SQL Server
ETL/ELT Tools: SSIS
Required Educational Background
• Bachelor’s degree in Computer Science, Information Technology, Information Systems, Engineering, or a related field.
• 6+ years of experience in data engineering or .NET development.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.