Search Jobs | Dice.com

Job Details

Skills

EC2
S3
EMR
EKS
IAM
VPC
CloudWatch
Lambda
AWS
Infrastructure as Code
HDFS
YARN
Hive
HBase
Spark
Apache Kafka clusters
Grafana
or Confluent Control Center
Big Data : Administration
Hadoop
Kafka Administration

Summary

JOB DESCRIPTION:

We are seeking a highly experienced Senior Big Data / AWS Administrator with 10+ years of hands-on experience in managing large-scale distributed systems. The ideal candidate will have deep expertise in AWS cloud infrastructure, Hadoop ecosystem, and Kafka administration, ensuring high availability, scalability, and performance of enterprise data platforms.

Key Responsibilities

Cloud & Infrastructure (AWS)

Design, deploy, and manage scalable, secure, and highly available infrastructure on AWS.
Administer core AWS services: EC2, S3, EMR, EKS, IAM, VPC, CloudWatch, Lambda.
Implement automated infrastructure provisioning using Infrastructure as Code (Terraform/CloudFormation).
Optimize cost, performance, and reliability of cloud environments.
Develop disaster recovery and backup strategies.

Big Data Platform Administration (Hadoop)

Install, configure, tune, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark).
Monitor cluster health, performance, and capacity planning.
Troubleshoot cluster issues and ensure high availability using HA configurations (NameNode HA, etc.).
Manage data ingestion and processing workflows.

Streaming Platform Administration (Kafka)

Install, configure, and manage Apache Kafka clusters.
Ensure high throughput, low latency, and fault-tolerant streaming systems.
Manage topics, partitions, brokers, and retention policies.
Perform Kafka cluster scaling, upgrades, and performance tuning.
Implement monitoring using tools like Prometheus, Grafana, or Confluent Control Center.

System Operations & Monitoring

Implement monitoring, logging, and alerting for all systems.
Conduct root cause analysis and performance tuning.
Ensure system security, access controls, and compliance standards.
Maintain detailed documentation and operational runbooks.

Automation & DevOps

Build CI/CD pipelines for infrastructure and platform deployments.
Automate routine administrative tasks using scripting (Python, Shell, etc.).
Collaborate with DevOps and engineering teams for platform improvements.

Required Skills & Qualifications

Experience

Minimum 10+ years of experience in system administration, with at least 5+ years in big data and cloud environments.
Proven experience managing large-scale Hadoop clusters and Kafka environments.
Strong hands-on experience with AWS cloud platform.
Agentic AI experience

Technical Skills

AWS services: AWS Administration, EC2, S3, EMR, IAM, VPC, CloudWatch, Lambda
Big Data : Administration, Hadoop, HDFS, Hive, Spark,
Kafka Administration

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90944144
Position Id: 9011873
Posted 22 days ago

Fitment

Dice Job Match Score™

🔗 Matching skills to job...

Contact the job poster

Sumanth Parikh

Recruiter @ Synkriom

View Profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

St. Louis, Missouri

•

Yesterday

Job Title: Senior Big Data DevOps Engineer (Kafka/AWS) Location: Denver, CO or St. Louis, MO Duration : 12 Months Job SummaryExperienced Big Data Administrator responsible for managing, supporting, automating, andoptimizingenterprise-scale Hadoop, Kafka, AWS cloud, and DevOps platforms. The role focuses on ensuring high availability, performance, security, scalability, and operational excellence across big data ecosystems while collaborating with development, architecture, and business teams. Ke

Easy Apply

Contract

Depends on Experience

AWS Data Architect Lead

St. Louis, Missouri

•

Today

job summary: This consulting position will report to a Data Architect Lead and will be responsible for implementing architecture patterns and designs across systems. They will engage in conceptual and logical data modeling, document database architecture, data integration, metadata and enablement of microservices and miniservice in an event driven architecture. location: St. Louis, Missouri job type: Contract salary: $85 - 90 per hour work hours: 9am to 5pm education: Bachelors responsibil

Contract

USD85 - USD90

AWS Systems Administrator

St. Louis, Missouri

•

Today

Job Description The Opportunity: We are looking for an AWS System Administrator to work on Enterprise Cross-Domain Systems and associated projects. These systems provide reliable data transfers between domains for general users and programs. In this role, you will be responsible for the day-to-day administration and maintenance of our AWS infrastructure. You will ensure the availability, performance, and security of our cloud-based systems and applications. Responsibilities: Manage AWS resou

Full-time

USD 120,000.00 - 149,000.00 per year

AWS ECDS Systems Administrator

St. Louis, Missouri

•

Today

Overview Abile Group has an exciting and challenging opportunity for an AWS ECDS Systems Administrator on a contract providing Network and Cybersecurity services supporting an Intelligence Community customer. All the personnel on the team will work together to support transport and cybersecurity information technology (IT) services on multiple networks and security domains, at multiple locations worldwide, inclusive of new facilities and building constructions to support the IC mission. The rig

Full-time

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Senior Hadoop and Big Data Administrator

Skills

Summary

Dice Job Match Score™

Sumanth Parikh

Similar Jobs

Senior Hadoop and Big Data Administrator

Job Details

Skills

Summary

Dice Job Match Score™

Sumanth Parikh

Similar Jobs