Description We are seeking a Senior Data Engineer to design, build, and optimize modern cloud-based data platforms. This role is responsible for developing scalable data pipelines, supporting enterprise analytics, and enabling data-driven decision making through robust integration, warehousing, and reporting solutions. The ideal candidate has strong Databricks experience, expertise with Azure data technologies, and a passion for building high-performance data platforms.
Responsibilities- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Python, Spark, and SQL.
- Build and optimize cloud-based data pipelines supporting structured and semi-structured data.
- Develop and maintain data lake and data warehouse solutions for enterprise reporting and analytics.
- Optimize data processing performance, reliability, and cost efficiency.
- Implement data quality, validation, and governance practices across the data platform.
- Collaborate with business and technical stakeholders to gather requirements and deliver scalable data solutions.
- Design integrations with cloud services, APIs, databases, and third-party systems.
- Develop dashboards, reporting datasets, and curated data products that enable self-service analytics.
- Contribute to cloud architecture, Infrastructure as Code, CI/CD automation, and platform best practices.
- Document data models, pipelines, and technical solutions while mentoring team members on modern data engineering practices.
Requirements - Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field.
- 7+ years of experience designing and supporting enterprise data platforms.
- Extensive hands-on experience with Databricks, Apache Spark, Python, SQL, and Delta Lake.
- Strong experience with Azure data services, including Azure Data Factory.
- Experience designing and supporting modern data lake and data warehouse architectures.
- Strong understanding of ETL/ELT development, data modeling, and database design.
- Experience with CI/CD pipelines, Infrastructure as Code, and cloud-based deployment practices.
- Familiarity with Azure, AWS, or hybrid cloud environments.
- Excellent analytical, problem-solving, and communication skills.
- Experience working in Agile development environments.
Preferred Qualifications- Experience with Microsoft Fabric.
- Experience working with large-scale scientific, research, or highly regulated datasets.
- Familiarity with data governance, security, and compliance best practices.
- Experience building high-performance analytics platforms in Azure or AWS.
Technology Doesn't Change the World, People Do.
Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.
Never miss an opportunity! Create an alert based on the job you applied for.