Senior AWS EMR / Spark Engineer - W2 Contract

Seattle, WA, US • Posted 19 hours ago • Updated 19 hours ago
Contract Independent
Contract W2
6 Months
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • DRAM
  • EMR
  • YARN
  • EBS
  • EC2
  • Spark

Summary

Amazon s RFM team is seeking an engineer to optimize DRAM usage across EMR on EC2 clusters through cluster tuning, Spark/YARN optimization, and EC2 instance right-sizing. The role involves analyzing utilization, identifying over-provisioned resources, running optimization experiments, and delivering measurable memory/cost savings without impacting performance or SLAs.
Key Responsibilities
Analyze EMR, Spark, YARN, and CloudWatch metrics to identify memory waste, underutilized executors, and inefficient cluster configurations.
Optimize EC2 instance types, node counts, EBS, and Spot/On-Demand fleet configurations, including R-family C-family migrations where appropriate.
Tune Spark/YARN configurations, including executor memory/cores, memory overhead, container sizing, dynamic allocation, and shuffle settings.
Perform end-to-end optimization experiments, deployments, testing, and metric validation using Amazon tools.
Monitor service health and ensure job performance, throughput, completion times, and SLAs are not degraded.
Collaborate with service teams and engineering leadership to present findings and implement optimization plans.
Create runbooks, SOPs, technical specifications, and reusable optimization playbooks for fleet-wide adoption.
Develop scalable frameworks to optimize hundreds of EMR clusters and enable other engineers to execute optimization workflows.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91135323
  • Position Id: 9057067
  • Posted 19 hours ago
Contact the job poster
LK

Lalith Kumar

Recruiter @ SDVS Technologies LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Redmond, Washington

Yesterday

Easy Apply

Full-time, Third Party

Depends on Experience

Seattle, Washington

Today

Easy Apply

Contract, Third Party

Depends on Experience

Bellevue, Washington

2d ago

Full-time

USD 230,000.00 - 270,000.00 per year

Bellevue, Washington

Today

Full-time

USD 230,000.00 - 270,000.00 per year

Search all similar jobs