EMR/Spark SQL Engineer

Amazon s RFM team is seeking an engineer to optimize DRAM usage across EMR on EC2 clusters through cluster tuning, Spark/YARN optimization, and EC2 instance right-sizing. The role involves analyzing utilization, identifying over-provisioned resources, running optimization experiments, and delivering measurable memory/cost savings without impacting performance or SLAs.Key ResponsibilitiesAnalyze EMR, Spark, YARN, and CloudWatch metrics to identify memory waste, underutilized executors, and ineffi

We are seeking a Senior Software Data Engineer to join our team in a software engineering capacity. This is not a data-science or analytics position centered on ad-hoc data exploration; instead, the role focuses on building software, data processing jobs, and data pipelines consumed by internal and external partners. Data is our main product and first-class citizen, and we value correct, high-quality data as much as clean and maintainable code. Responsibilities Write new data pipelines and jobs

Role Description: Competencies: 6+ years experience required Amazon Web Service(AWS) Cloud Computing Advanced Java Concepts Microsoft SQL Server 2019 Java Performance Tools (Jprobe, Jensor, OptimizeIT) Must Have TechnicalFunctional Skills AWS EMR Cluster Operations Spark & YARN Tuning Memory Optimization & Capacity Analysis EC2 Right-Sizing & Cost Optimization Monitoring & Troubleshooting (CloudWatchLogs) Roles & Responsibilities: Analyze EMR cluster metrics, Spark application telemetry, and YAR

Job Title: PySpark developer Location: Irving, TX- Hybrid Role Overview Experience with big data processing and distributed computing systems like Spark. Implement ETL pipelines and data transformation processes. Ensure data quality and integrity in all data processing workflows. Troubleshoot and resolve issues related to PySpark applications and workflows. Understand source, dependencies and data flow from converted PySpark code. Strong programming skills in Python and SQL. Experience with bi