Senior Big Data Admin

St. Louis, MO, US • Posted 10 hours ago • Updated 10 hours ago
Contract W2
On-site
Depends on Experience
Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

  • Access Control
  • Amazon EC2
  • Amazon S3
  • Amazon Web Services
  • Apache HBase
  • Apache Hadoop
  • Apache Hive
  • Apache Kafka
  • Apache Spark
  • Artificial Intelligence
  • Big Data
  • Backup
  • Capacity Management
  • Cloud Computing
  • Collaboration
  • Continuous Delivery
  • Continuous Integration
  • Data Management
  • DevOps
  • Disaster Recovery
  • Documentation
  • Electronic Health Record (EHR)
  • Grafana
  • HDFS
  • High Availability
  • IaaS
  • Management
  • Performance Tuning
  • Provisioning
  • Python
  • Regulatory Compliance
  • Root Cause Analysis
  • Scalability
  • Scripting
  • Shell
  • Streaming
  • System Administration
  • System Security
  • Terraform
  • Virtual Private Cloud
  • Workflow
  • AWS Administration
  • Hadoop Administration

Summary

Role Overview

We are seeking a highly experienced Senior Big Data / AWS Administrator with 10+ years of hands-on experience in managing large-scale distributed systems. The ideal candidate will have deep expertise in AWS cloud infrastructure, Hadoop ecosystem, and Kafka administration, ensuring high availability, scalability, and performance of enterprise data platforms.

Key Responsibilities

Cloud & Infrastructure (AWS)

  • Design, deploy, and manage scalable, secure, and highly available infrastructure on AWS.
  • Administer core AWS services: EC2, S3, EMR, EKS, IAM, VPC, CloudWatch, Lambda.
  • Implement automated infrastructure provisioning using Infrastructure as Code (Terraform/CloudFormation).
  • Optimize cost, performance, and reliability of cloud environments.
  • Develop disaster recovery and backup strategies.

Big Data Platform Administration (Hadoop)

  • Install, configure, tune, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark).
  • Monitor cluster health, performance, and capacity planning.
  • Troubleshoot cluster issues and ensure high availability using HA configurations (NameNode HA, etc.).
  • Manage data ingestion and processing workflows.

Streaming Platform Administration (Kafka)

  • Install, configure, and manage Apache Kafka clusters.
  • Ensure high throughput, low latency, and fault-tolerant streaming systems.
  • Manage topics, partitions, brokers, and retention policies.
  • Perform Kafka cluster scaling, upgrades, and performance tuning.
  • Implement monitoring using tools like Prometheus, Grafana, or Confluent Control Center.

System Operations & Monitoring

  • Implement monitoring, logging, and alerting for all systems.
  • Conduct root cause analysis and performance tuning.
  • Ensure system security, access controls, and compliance standards.
  • Maintain detailed documentation and operational runbooks.

Automation & DevOps

  • Build CI/CD pipelines for infrastructure and platform deployments.
  • Automate routine administrative tasks using scripting (Python, Shell, etc.).
  • Collaborate with DevOps and engineering teams for platform improvements.

Required Skills & Qualifications

Experience

  • Minimum 10+ years of experience in system administration, with at least 5+ years in big data and cloud environments.
  • Proven experience managing large-scale Hadoop clusters and Kafka environments.
  • Strong hands-on experience with AWS cloud platform.
  • Agentic AI experience

Technical Skills

  • AWS services: AWS Administration, EC2, S3, EMR, IAM, VPC, CloudWatch, Lambda
  • Big Data : Administration, Hadoop, HDFS, Hive, Spark,
  • Kafka Administration
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 90944144
  • Position Id: 8998685
  • Posted 10 hours ago
Contact the job poster
SP

Sumanth Parikh

Recruiter @ Synkriom
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

St. Louis, Missouri

Today

Easy Apply

Contract

$70+

Kansas

Today

Full-time

USD 90,000.00 - 100,000.00 per year

Remote

Today

Easy Apply

Contract

$60 - $70

Remote

Today

Full-time

Search all similar jobs