Description OverviewWe are seeking a Senior Data Engineer to support a major Salesforce Phase 2 data migration initiative. This role will focus heavily on building and optimizing data pipelines, developing ETL workflows, and moving CRM data from Salesforce into Databricks.
The engineer will work closely with a senior team member, contribute to Scrum ceremonies, and play a key role in developing the core CRM data environment used by the advertising organization.
Key ResponsibilitiesData Engineering & Migration- Develop ETL jobs that move and transform Salesforce data into Databricks.
- Build, test, and maintain high-volume data pipelines across AWS + Databricks.
- Perform data migration, data integration, and pipeline development (including Mulesoft-related work).
- Ensure all pipelines are reliable, scalable, and optimized for production.
Development & Infrastructure- Use Python and PySpark to build ETL components and transformation logic.
- Leverage Spark/PySpark for distributed processing at scale (must-have).
- Use Terraform to provision and manage cloud infrastructure.
- Set up CI/CD pipelines using Concourse or GitHub Actions for automated deployments.
Quality, Documentation & Support- Document ETL processes, pipelines, and data flows.
- Participate in testing, QA, and validation of migrated datasets.
- Provide post-delivery support and proactively mitigate project risks or single points of failure (SPOF).
- Troubleshoot production issues and implement long-term fixes to maintain pipeline stability.
Collaboration- Work closely with engineering teammates to translate business requirements into working pipelines.
- Participate in weekly Scrum ceremonies.
- Contribute to shared best practices and continuous improvement across the data engineering team.
Requirements RequirementsMust-Have Skills- 7-9 yearsof experience in data engineering or data integration roles.
- Strong experience withDatabricks.
- Deep experience withSparkandPySpark(non-negotiable).
- StrongPythondevelopment skills for ETL, transformations, and automation.
- Hands-on experience building pipelines onAWS.
- Experience withTerraform(infrastructure as code).
- Experience with CI/CD (ConcourseorGitHub Actions).
Nice-to-Have Skills- Exposure toSalesforce data modelsor CRM systems.
- Experience withMulesoft.
- Knowledge ofJava(not required).
- Prior work with advertising or large enterprise datasets.
Soft Skills- Strong problem-solving mindset with the ability to troubleshoot quickly.
- Excellent communication and documentation abilities.
- Collaborative approach and willingness to partner with senior engineers.
Technology Doesn't Change the World, People Do.
Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.
Never miss an opportunity! Create an alert based on the job you applied for.