Job Role: System Administrator(AWS EMR)
Location: Allen, TX /Remote
Job Description:
Must Have Technical/Functional Skills
- Big Data Admin for AWS EMR (Elastic MapReduce) Big Data and Hadoop ecosystem.
- Experience with Terraform, CloudFormation, and other DevOps tools.
- Strong Linux administration and scripting (Bash, Python).
- Familiarity with AWS services like S3, EC2, IAM, CloudWatch.
Roles & Responsibilities
AWS EMR (Elastic MapReduce) Big Data Administrator is responsible for designing, deploying, configuring, and maintaining big data environments on AWS using EMR, Hadoop, Spark, Hive, and related technologies.
Key Responsibilities:
- EMR Cluster Administration:
- Provision, configure, and manage Amazon EMR clusters.
- Optimize sizing, auto-scaling, and performance.
- Manage Hadoop components including HDFS, YARN, Hive, and Spark.
- Big Data Platform Operations:
- Install, configure, and upgrade big data tools.
- Monitor cluster health and troubleshoot failures.
- Manage data ingestion pipelines including Kafka, Kinesis, and AWS Glue.
- Security, Compliance & IAM:
- Implement EMR security with IAM, Kerberos, KMS, and VPC configurations.
- Ensure compliance with organizational standards.
- Automation & DevOps:
- Automate EMR provisioning using CloudFormation, CDK, or Terraform.
- Build CI/CD pipelines using AWS tools or Jenkins.
- Implement cost optimization strategies.
- Monitoring & Troubleshooting:
- Use CloudWatch, CloudTrail, and EMR Console for diagnostics.
- Tune Spark and Hive jobs for performance.
- Collaboration & Support:
- Work closely with data engineers and cloud teams.
- on-call assistance.
Education
Bachelor s Degree
Never miss an opportunity! Create an alert based on the job you applied for.
