Description
We are looking for a Data Engineer to join a confidential enterprise organization in McKinney, Texas and help advance a large-scale cloud data environment. This contract opportunity with potential for a permanent role focuses on building and refining a modern lakehouse platform in Azure, with a strong emphasis on Azure Databricks and scalable data engineering practices. The role will work across technical and business teams to create dependable, secure, and high-performing data solutions that support analytics and decision-making.
Responsibilities:
Create and maintain robust data pipelines in Azure Databricks using Spark-based engineering approaches to support large-volume processing needs.
Build ingestion frameworks that bring data from APIs, event streaming platforms, cloud storage, and enterprise systems into structured lakehouse layers.
Apply lakehouse design standards across bronze, silver, and gold environments to improve data usability, consistency, and downstream reporting value.
Enhance platform efficiency by tuning Spark workloads, refining storage strategies, and improving processing performance and cost management.
Connect Databricks solutions with Azure services such as Data Factory, Synapse, Data Lake Storage, Event Hub, Key Vault, and Azure DevOps.
Establish secure data access patterns through governance controls, identity-based access, and protection measures such as masking and policy alignment.
Partner with architects, analysts, data scientists, and business stakeholders to deliver trusted datasets, metrics, and KPI-ready data assets.
Strengthen data reliability by implementing validation checks, monitoring, lineage tracking, alerting, and recovery processes for critical workflows.
Contribute technical leadership through code reviews, engineering guidance, and mentoring support for other members of the data team.
Requirements
Bachelor's degree in Computer Science, Engineering, or a related discipline, or equivalent hands-on experience.
At least 5 years of data engineering experience, including 3 or more years working with Azure Databricks and Apache Spark using PySpark.
Strong knowledge of Delta Lake, Unity Catalog, Databricks notebooks, and cloud-based data warehousing concepts, including Snowflake-related environments.
Hands-on experience with Azure Data Lake Storage, Event Hub, Azure Data Factory, Key Vault, Synapse, and Microsoft Fabric.
Advanced programming skills in Python and SQL, with additional exposure to Scala considered beneficial.
Solid understanding of dimensional modeling, star and snowflake schema design, and data platform performance optimization.
Experience supporting CI/CD and deployment automation for Databricks environments using tools such as Azure DevOps, Terraform, or related frameworks.
Familiarity with data governance, compliance, and security standards, along with exposure to real-time data pipelines, reporting platforms, or ML-enabled workflows.
Technology Doesn't Change the World, People Do.
Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: rhalfint
- Position Id: 04010-0013540319
- Posted 12 hours ago
