Search Jobs | Dice.com

Job Details

Skills

Kubernetes
AWS
Etl
Python
PySpark
IAM
AI
Glue
Redshift
Data Engineer
Lambda
EMR
s3
Athena
CloudWatch
Artificial Intelligence
ELT
AWS cloud services
ECS/EKS

Summary

Position: Sr. Data Engineer (AI + AWS)

Location: Irvine/LA, CA (Onsite)

Duration: Long term contract

Job Summary:

We are seeking a highly skilled Data Engineer with expertise in AI-enabled data platforms, AWS cloud services, Python, PySpark, and Kubernetes to design, develop, and optimize scalable data pipelines and machine learning data infrastructure. The ideal candidate will have experience building cloud-native data solutions, processing large-scale datasets, and supporting AI/ML workloads in AWS environments.

Key Responsibilities:

Design, build, and maintain scalable ETL/ELT data pipelines using Python and PySpark.
Develop cloud-native data solutions utilizing AWS services such as S3, EMR, Glue, Lambda, Redshift, Athena, ECS/EKS, IAM, CloudWatch, and Step Functions.
Build and optimize data ingestion frameworks for structured, semi-structured, and streaming data.
Collaborate with Data Scientists and AI Engineers to prepare, transform, and deliver high-quality datasets for AI/ML model training and inference.
Deploy and manage containerized data applications using Kubernetes (EKS) and Docker.
Develop data processing workflows using Spark and optimize performance for large-scale distributed processing.
Design data lakes and modern data architectures following AWS best practices.
Implement data quality checks, monitoring, logging, and alerting mechanisms.
Optimize SQL queries and data models for analytical workloads.
Build CI/CD pipelines for automated deployment of data engineering solutions.
Ensure data governance, security, compliance, and access controls across cloud environments.
Troubleshoot production issues and provide performance tuning for distributed data systems.
Work closely with cross-functional teams in Agile/Scrum environments.

Required Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or related field.
10+ years of Data Engineering experience.
Strong programming experience in Python.
Hands-on expertise with PySpark and Apache Spark.
Strong experience with AWS Cloud services.
Experience with Kubernetes (EKS) and Docker.
Strong SQL skills and experience with relational databases.
Experience building scalable ETL/ELT pipelines.
Familiarity with Git and CI/CD practices.
Excellent analytical, debugging, and problem-solving skills.

Required Technical Skills:

Cloud: AWS (S3, Glue, EMR, Lambda, Redshift, Athena, ECS/EKS, IAM, CloudWatch, Step Functions)
Programming: Python
Big Data: PySpark, Apache Spark
Containers: Kubernetes, Docker
Databases: PostgreSQL, MySQL, SQL Server, Redshift
Data Storage: Data Lake, Data Warehouse
Version Control: Git
Operating Systems: Linux
Methodology: Agile/Scrum

AI/ML Experience:

Support AI/ML data pipelines and feature engineering.
Prepare datasets for model training and inference.
Experience integrating ML workflows into cloud-based data platforms.
Familiarity with LLMs, Generative AI, Vector Databases, or Retrieval-Augmented Generation (RAG) is a plus.
Experience with AWS AI services such as Amazon SageMaker, Bedrock, or Amazon OpenSearch is preferred.

Preferred Qualifications:

Experience with Apache Airflow or AWS Managed Workflows (MWAA).
Knowledge of Kafka or Kinesis for streaming data.
Experience with Delta Lake, Iceberg, or Apache Hudi.
Infrastructure-as-Code experience using Terraform or CloudFormation.
AWS certifications (Solutions Architect, Data Engineer, or Machine Learning Specialty) are highly desirable.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10121956
Position Id: 2026-5008
Posted 2 days ago

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Python Lead Data Engineer - W2 Position

Irvine, California

•

2d ago

Title : Python Lead Data Engineer Location :Irvine, CA (onsite) Rate : $60/hr on W2 Duration : 12 Months Position : W2 Position Relevant Experience (in Yrs.): Detailed Job Description We are looking for a Python Lead Data Engineer with 10+ years of experience in data engineering and AWS cloud technologies. The ideal candidate should have strong hands-on experience in Python, SQL, AWS, and data processing. Experience in the Financial Services domain, Agile methodology, and working directly wi

Easy Apply

Contract

57 - 60

AWS Data Lead / Lead Consultant - Data on Cloud Platform

South Carolina

•

25d ago

AWS Data Lead / Lead Consultant Data on Cloud Platform Location: Fort Mill, SC 29715 (Hybrid/Onsite) Work Arrangement: Hybrid Candidates must be willing to work onsite. Candidates open to relocating to Fort Mill, SC will also be considered. Contract Duration: 6 Months Target Start Date: June 15, 2026 Interview Process: Virtual Position Overview We are seeking an experienced AWS Data Lead to design, develop, and lead enterprise-scale cloud data integration and data warehousing initiativ

Easy Apply

Third Party

Senior Data Engineer Cloud & DevOps

Remote

•

19d ago

Role Our Data & Analytics organization is seeking a Senior Data Engineer with a strong DevOps foundation to support the modernization of its enterprise data platform. This role sits at the intersection of data engineering and cloud operations youll be designing and maintaining robust data pipelines, automating platform operations, and helping shape customers evolving AI and agentic data strategy. Remote-first with occasional in-person sessions required. What Youll DoDesign, build, and maintain

Easy Apply

Contract

Depends on Experience

Senior Data Engineer

Remote

•

25d ago

Role:Senior Data Engineer Location: Remote Duration:6+ Month Contract Job Summary We are seeking a hands-on Senior Data Engineer with 5+ years of experience building and supporting enterprise-scale data platforms. The ideal candidate will have strong expertise in AWS, Python, SQL, ETL/ELT development, data integration, and modern data engineering practices. This role will be responsible for designing, developing, and optimizing scalable data pipelines that support analytics, reporting, and busin

Easy Apply

Contract

Depends on Experience

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Sr. Data Engineer (AI + AWS)

Skills

Summary

Dice Job Match Score™

Similar Jobs

Sr. Data Engineer (AI + AWS)

Job Details

Skills

Summary

Dice Job Match Score™

Similar Jobs