Description Position Overview
We are seeking a delivery-focused Data Automation Engineer to design and implement innovative automation solutions across a Microsoft Azure-based data analytics platform. This role partners closely with engineering teams and stakeholders to translate business requirements into scalable data engineering and AI-enabled solutions.
The ideal candidate is hands-on with Azure Data Factory, Synapse Pipelines, Apache Spark, Python, and SQL, and brings experience building reliable ETL pipelines across SQL and NoSQL environments. This role emphasizes performance optimization, automation, and proactive data quality within Agile DevOps delivery models.
Key Responsibilities
Data Engineering & Automation
- Develop high-performance data pipelines using Azure Data Factory, Synapse Pipelines, Spark Notebooks, Python, and SQL.
- Design ETL workflows supporting advanced analytics, reporting, and AI/ML use cases.
- Implement data migration, integrity, quality, metadata, and security controls across pipelines.
- Monitor, troubleshoot, and optimize pipelines for availability, scalability, and performance.
Performance Testing & Optimization
- Execute ETL performance testing and validate load performance against benchmarks.
- Analyze pipeline runtime, throughput, latency, and resource utilization.
- Support tuning activities (e.g., query optimization, partitioning, indexing).
- Validate data completeness and consistency after high-volume processing.
Platform Collaboration & DevOps Support
- Collaborate with DevOps and infrastructure teams to optimize compute, memory, and scaling.
- Maintain versioning and configuration control across environments.
- Support production, testing, development, and integration environments.
- Actively participate in Agile delivery processes including Program Increment planning.
Requirements Required Qualifications
- Bachelor's degree in Computer Science or related field.
- 2+ years of experience with SQL, T-SQL, DAX/MDX, Python, or PySpark.
- Experience designing and building ETL solutions within cloud environments.
- Hands-on experience with Azure Data Factory, Synapse, or Azure Data Lake.
- Experience with Microsoft BI tools including SQL Server, SSIS, SSRS, SSAS, or Power BI.
- Familiarity with Azure/AWS CLI automation using Bash or PowerShell.
- Experience with Git or Azure DevOps for release/version management.
- Experience working in Agile environments.
- Ability to obtain a Public Trust clearance required.
Preferred Qualifications
- Certification in Azure, Power BI, AI, or AWS data engineering.
- Experience with Generative AI tools or data automation use cases.
- Familiarity with REST APIs, Docker, or enterprise ETL tools.
- Exposure to performance tuning, query analytics, or data profiling.
- Knowledge of ARM/Bicep templates or RBAC access controls.
- Familiarity with data lineage or governance tools (e.g., Microsoft Purview).
Technology Doesn't Change the World, People Do.
Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.
Never miss an opportunity! Create an alert based on the job you applied for.