Overview
On Site
$60 - $70
Contract - W2
Contract - 12 Month(s)
Skills
Data Integration
Python
Microsoft Azure
Data Engineering
Data Governance
DevOps
Terraform
IaC
Job Details
Role: We are seeking a highly motivated and experienced Senior Data Engineer with deep expertise in Azure and working knowledge of AWS, to lead the design and implementation of scalable cloud-based data solutions. This role requires strong skills in cloud application and data integration, DevOps practices, and big data technologies, with a focus on building robust, secure, and high-performance data pipelines and services.
Key Responsibilities:
- Architect and develop scalable data pipelines and integration workflows across Azure and AWS environments
- Lead cloud application integration using SOAP and REST APIs, ensuring secure and reliable data exchange
- Implement data integration solutions using Azure Data Factory, Synapse, AWS Glue, or similar tools
- Develop reusable components and automation scripts using Python for data transformation and orchestration
- Collaborate with DevOps teams to manage CI/CD pipelines using GitHub
- Monitor Production systems, troubleshoot incidents, and perform in-depth root cause investigations
Must-have Requirements:
- 8+ years of experience in data engineering with strong focus on Azure and working knowledge of AWS
- Proven experience in cloud application integration using SOAP/REST APIs
- Hands-on expertise in Azure Data Factory, Synapse and AWS Glue
- Good knowledge of Rest V2, Swagger file generation and Python scripting
- Strong experience in DevOps platforms such as GitHub with hands-on experience in branching, merge strategy, rebasing and reviewing history
- Solid understanding of Azure and AWS architecture, cloud security and data governance
Preferred Requirements:
- Experience with Terraform Cloud (IaC)
- Experience in Snowflake
- Azure or AWS certifications
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.