Data Engineer

Description

We are seeking a seasoned Databricks Data Engineer with expertise in Azure cloud services and the Databricks Lakehouse platform. The role involves designing and optimizing large-scale data pipelines, modernizing cloud-based data ecosystems, and enabling secure, governed data solutions. Strong skills in SQL, Python, PySpark, ETL/ELT frameworks, and experience with Delta Lake, Unity Catalog, and CI/CD automation are essential.

About the Role

We are seeking a highly skilled Databricks Data Engineer with deep expertise in data engineering, Azure cloud services, and Databricks Lakehouse technologies. This role will focus on building scalable, secure, and high-performance data solutions for enterprise analytics.

Key Responsibilities

• Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform.
• Modernize the Azure-based data ecosystem, including architecture, data modeling, security, and CI/CD automation.
• Implement orchestration and workflow automation using Apache Airflow and similar tools.
• Work with regulated datasets, ensuring compliance and governance best practices.

Requirements

Required Skills & Experience

• 8+ years of experience in data engineering and modern data warehousing.
• Advanced proficiency in SQL, Python, PySpark, and ETL/ELT frameworks.
• Hands-on experience with Azure, Databricks, Snowflake, and enterprise system integration.
• Expertise in Delta Lake, Unity Catalog, and Databricks workflows.
• Strong knowledge of CI/CD automation and DevOps practices.

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.