Overview
Skills
Job Details
Job Role: Azure Data Engineer Location: Dallas, TX (local and H1B) PP number and Linkedin mandatory Candidates comfortable for in person interview
Key Responsibilities
Design and implement end-to-end data pipelines and data integration solutions using Azure Data Factory (ADF), Databricks, and Synapse Analytics.
Build and maintain data lakes, data warehouses, and data marts to support business intelligence and analytics needs.
Develop ETL/ELT workflows for ingesting structured and unstructured data from various on-premise and cloud sources.
Optimize data storage and compute performance for scalability and cost-efficiency.
Collaborate with data analysts, data scientists, and application developers to meet data requirements and ensure quality.
Implement data governance, security, and compliance best practices.
Create and maintain technical documentation, including data models, flow diagrams, and process maps.
Automate data validation and monitoring processes to ensure data accuracy and consistency.
Troubleshoot data pipeline issues, optimize queries, and tune performance across large datasets.
Stay up-to-date on emerging Azure data technologies and recommend improvements to current architecture.
Required Qualifications
Bachelor s degree in Computer Science, Data Science, Information Systems, or a related field.
5+ years of experience in data engineering, preferably within a Microsoft Azure environment.
Strong hands-on experience with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Proficiency in SQL, Python, or PySpark for data transformation and automation.
Solid understanding of data modeling, data warehousing, and data lake architectures.
Experience with ETL/ELT design patterns and best practices.
Strong grasp of Azure storage solutions (Blob Storage, Data Lake Storage Gen2).
Experience with version control tools (Git, Azure DevOps) and CI/CD pipelines.
Knowledge of data governance, security, and compliance frame