Senior AWS EMR / Spark Engineer - W2 Contract

Seattle, WA, US • Posted 1 day ago • Updated 13 hours ago
Contract W2
Contract Independent
6 Months
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • DRAM
  • EMR
  • YARN
  • EBS
  • EC2
  • Spark

Summary

Amazon’s RFM team is seeking an engineer to optimize DRAM usage across EMR on EC2 clusters through cluster tuning, Spark/YARN optimization, and EC2 instance right-sizing. The role involves analyzing utilization, identifying over-provisioned resources, running optimization experiments, and delivering measurable memory/cost savings without impacting performance or SLAs.
Key Responsibilities
• Analyze EMR, Spark, YARN, and CloudWatch metrics to identify memory waste, underutilized executors, and inefficient cluster configurations.
• Optimize EC2 instance types, node counts, EBS, and Spot/On-Demand fleet configurations, including R-family → C-family migrations where appropriate.
• Tune Spark/YARN configurations, including executor memory/cores, memory overhead, container sizing, dynamic allocation, and shuffle settings.
• Perform end-to-end optimization experiments, deployments, testing, and metric validation using Amazon tools.
• Monitor service health and ensure job performance, throughput, completion times, and SLAs are not degraded.
• Collaborate with service teams and engineering leadership to present findings and implement optimization plans.
• Create runbooks, SOPs, technical specifications, and reusable optimization playbooks for fleet-wide adoption.
• Develop scalable frameworks to optimize hundreds of EMR clusters and enable other engineers to execute optimization workflows.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91135323
  • Position Id: 9055591
  • Posted 1 day ago
Contact the job poster
LK

Lalith Kumar

Recruiter @ SDVS Technologies LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Redmond, Washington

Today

Easy Apply

Full-time, Third Party

Depends on Experience

Seattle, Washington

Today

Easy Apply

Third Party, Contract

Depends on Experience

Bellevue, Washington

Yesterday

Full-time

USD 230,000.00 - 270,000.00 per year

Bellevue, Washington

Today

Full-time

USD 230,000.00 - 270,000.00 per year

Search all similar jobs