Overview
On Site
Depends on Experience
Full Time
Skills
Amazon SageMaker
PySpark
Data Engineer
AWS
Job Details
Role : AWS Data Engineer with Sage maker
Location : Herndon (Looking Local Profile-Onsite)
Duration: Full Time
Job Description:
- AWS services (EMR, SageMaker, Lambda, RedShift, Glue, SNS, SQS)
- PySpark and data processing frameworks
- Shell scripting and Python development
- CI/CD tooling experience (Jenkins, UCD)
- Source control experience with Bitbucket and GitHub
- Experience building and maintaining scripts/tools for automation
Key Responsibilities
- Design and implement scalable ETL/ELT pipelines on AWS for batch and near-real-time workloads.
- Build and optimize data processing jobs using PySpark on EMR and Glue.
- Develop and manage RedShift schemas, queries, and Spectrum for external table access.
- Integrate machine learning workflows with SageMaker and Lambda-driven orchestration.
- Automate deployments and testing using CI/CD tools and source control (Jenkins, UCD, Bitbucket, GitHub).
- Create and maintain operational scripts and tooling (Shell, Python) for monitoring, troubleshooting, and performance tuning.
Nice-to-have
- Familiarity with AWS ECS
- Experience with Aurora PostgreSQL
- Java for tooling or pipeline components
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.