Overview
On Site
Contract - W2
Contract - Independent
Contract - Contract
Skills
sql
data engineering
Optimization
Data Pipelines
Azure Data Factory
Job Details
Job Title: Data Engineer
Location: Irving, TX / Houston, TX / Atlanta, GA / Chicago, IL (3 days per week onsite)
Job Description:
Key Responsibilities
- Design, develop, and maintain robust data pipelines for ingesting, transforming, and loading data from multiple sources
- Build and manage ETL / ELT workflows using Azure Data Factory
- Develop and optimize SQL queries, stored procedures, and data models for performance and scalability
- Work with Databricks / data clusters to process large-scale structured and unstructured data
- Implement data normalization and data quality best practices to ensure accuracy and consistency
- Optimize data pipelines, jobs, and queries to improve performance, cost, and reliability
- Monitor, troubleshoot, and resolve data pipeline failures and performance bottlenecks
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
- Ensure data security, governance, and compliance with organizational standards
Required Skills & Qualifications
- Strong experience in data pipeline development
- Hands-on experience with Azure Data Factory
- Proficiency in SQL for data querying, transformation, and optimization
- Experience working with Databricks and distributed data clusters
- Solid understanding of ETL / ELT concepts and implementations
- Experience in data optimization techniques (query tuning, indexing, partitioning, caching)
- Strong knowledge of data normalization and data modeling principles
- Ability to work with large datasets and high-volume data systems
Preferred Qualifications
- Experience with Azure cloud services (Azure Data Lake, Azure Synapse, etc.)
- Knowledge of performance tuning in distributed data processing environments
- Familiarity with CI/CD for data pipelines
- Understanding of data governance and data quality frameworks
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.