Description Data Automation Engineer - AI / AWS / Azure
Work Arrangement: Remote
Clearance Requirement: Ability to obtain Public Trust
Position Overview
We are seeking a highly skilled Data Automation Engineer to design and implement advanced, AI-driven automation solutions across hybrid AWS and Azure environments. This role is focused on building scalable data pipelines, integrating modern cloud services, and leveraging Generative AI technologies to enhance enterprise analytics and operational workflows.
The ideal candidate is a hands-on engineer with strong expertise in data engineering, cloud platforms, and automation, combined with the ability to innovate and solve complex technical challenges. This role provides the opportunity to work on mission-critical systems, supporting large-scale data processing, reporting, and AI-enabled applications.
Key Responsibilities
Data Engineering & Pipeline Development
- Design, build, and maintain scalable data pipelines using AWS services (S3, Glue, Lambda, EMR, DynamoDB)
- Develop and optimize ETL/ELT workflows across hybrid AWS and Azure environments
- Integrate structured, unstructured, and streaming data across enterprise systems
AI & Automation Engineering
- Leverage Generative AI frameworks (AWS Bedrock, Azure OpenAI, LangChain, Hugging Face) to build intelligent automation
- Implement solutions for embeddings, vector generation, and RAG workflows
- Develop AI-driven tools for data quality, anomaly detection, and pipeline optimization
- Build AI-powered copilots for monitoring, troubleshooting, and workflow automation
Data Platform Integration & Optimization
- Engineer real-time and batch ingestion pipelines using Spark, Kafka, and Flume
- Integrate enterprise platforms and CRM data into data pipelines for analytics and reporting
- Optimize SQL performance through stored procedures, indexing, and query tuning
Cloud & DevOps Practices
- Implement CI/CD pipelines using tools such as GitHub, Jenkins, or Azure DevOps
- Develop infrastructure solutions using Infrastructure-as-Code (IaC)
- Ensure cloud security through IAM, RBAC, encryption, and network isolation
Collaboration & Delivery
- Partner with cross-functional teams to gather requirements and deliver solutions
- Support Agile delivery processes and continuous improvement initiatives
- Provide technical troubleshooting and performance optimization across data systems
Requirements Required Qualifications
- Bachelor's degree in Computer Science or related field
- 2+ years of experience in data engineering, automation, or cloud development
- Strong experience with Python and SQL
- Hands-on experience with AWS services (S3, Glue, Lambda, EMR, DynamoDB)
- Experience with data pipeline development and ETL/ELT processes
- Familiarity with Spark, Kafka, Flume, or large-scale data processing
- Exposure to Generative AI / LLM frameworks
- Experience with CI/CD tools and DevOps practices
- Strong troubleshooting, performance tuning, and problem-solving skills
- Ability to obtain Public Trust clearance
Preferred Qualifications
- Certifications in AWS, Azure, or Data Engineering disciplines
- Experience implementing RAG pipelines, embeddings, or vector search technologies
- Experience with multi-cloud data integration (AWS ? Azure)
- Familiarity with data governance, lineage, and compliance frameworks
- Experience with GenAI-powered developer tools
- Familiarity with Infrastructure-as-Code (Terraform, CloudFormation, Bicep)
- Experience in regulated environments (FedRAMP, HIPAA, etc.)
Additional Details
- Opportunity to work on cutting-edge AI and automation platforms
- Exposure to enterprise-scale data systems and cloud architectures
- Strong focus on innovation, scalability, and continuous improvement
Technology Doesn't Change the World, People Do.
Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.
All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.
Never miss an opportunity! Create an alert based on the job you applied for.