Role: Azure Data Engineer
Location: Dalla, TX (Hybrid)
Duration: Full Time
Description
Seeking an Overseas Contractor with 8+ years of experience to design develop and maintain scalable data engineering solutions using Python and Azure Data Factory within the Azure Data Factory ADF skill cluster
Job Description
Collaborate closely with source data application teams and product owners to gather and translate business requirements into robust technical solutions Design develop and maintain scalable and efficient data pipelines and ETL processes using Python and Azure Data Factory Implement data migration and transformation workflows leveraging Azure cloud services to enable efficient data ingestion processing and storage Ensure data quality security and compliance by adhering to best practices and governance policies within Azure environments Optimize performance of data pipelines and cloud infrastructure to support largescale data processing Support continuous integration and continuous deployment CICD pipelines for data engineering projects Stay updated with emerging Azure and data engineering technologies and recommend improvements to existing solutions Work independently and collaboratively within crossfunctional teams to deliver data engineering solutions aligned with business objectives
Roles and Responsibilities
Lead the design and implementation of scalable and reusable batch and streaming data pipelines using Python and Azure Data Factory Provide technical leadership and mentorship to junior engineers and team members on best practices in Python programming and Azure Data Factory Collaborate with DevOps teams to manage deployment monitoring and support of data engineering solutions Troubleshoot and resolve data pipeline issues to ensure high availability reliability and optimal performance Participate in architectural discussions and contribute to the development and enforcement of coding standards security guidelines and privacy compliance Engage with stakeholders to gather requirements and translate them into technical solutions aligned with business goals Drive continuous improvement initiatives by researching and applying industry best practices in cloud data engineering Support production environments with timely incident response and root cause analysis
Skills
Mandatory Skills : Azure Data Factory, PySpark-Data Science, Python
Never miss an opportunity! Create an alert based on the job you applied for.