Kafka Administrator / Fort Mill, SC, USA

  • Fort Mill, SC
  • Posted 1 day ago | Updated 1 day ago

Overview

On Site
$40 - $50
Contract - W2

Skills

Kafka Administrator

Job Details

Job Title: Kafka Administrator

Job Summary

We are looking for an experienced Kafka Administrator to manage, optimize, and scale our Apache Kafka infrastructure. The ideal candidate will ensure high availability, performance, and security of Kafka clusters while supporting real-time data streaming needs across the organization.

Key Responsibilities

  1. Kafka Cluster Management:

    • Install, configure, and maintain Apache Kafka clusters (on-premises or cloud).

    • Manage Zookeeper ensembles and Kafka brokers for fault tolerance.

    • Perform upgrades, patches, and migrations with minimal downtime.

  2. Performance Tuning & Monitoring:

    • Optimize Kafka for high throughput and low latency.

    • Monitor cluster health, broker performance, and topic metrics using tools like Prometheus, Grafana, or Confluent Control Center.

    • Troubleshoot issues related to replication, partitioning, and consumer lag.

  3. Security & Access Control:

    • Implement security measures such as SSL/TLS, SASL, Kerberos, and ACLs.

    • Configure role-based access control (RBAC) for Kafka topics and schemas.

    • Ensure compliance with data governance policies.

  4. Scalability & Disaster Recovery:

    • Design and implement multi-datacenter replication (MirrorMaker, Confluent Replicator).

    • Set up backup and recovery strategies for Kafka topics.

    • Plan and execute cluster scaling (horizontal/vertical).

  5. Integration & Automation:

    • Work with DevOps teams to automate Kafka deployments using Ansible, Terraform, or Kubernetes (K8s).

    • Collaborate with data engineers to integrate Kafka with Spark, Flink, or databases.

  6. Documentation & Best Practices:

    • Maintain documentation on configurations, troubleshooting, and best practices.

    • Train development teams on Kafka usage and optimization.

Required Skills & Qualifications

  • Technical Skills:

    • Strong expertise in Apache Kafka, Confluent Platform, or MSK (AWS Managed Kafka).

    • Hands-on experience with Kafka Connect, Schema Registry, and KSQL.

    • Knowledge of Linux/Unix administration, networking, and scripting (Bash/Python).

    • Familiarity with JVM tuning and garbage collection optimization.

  • Soft Skills:

    • Strong analytical and problem-solving skills.

    • Ability to work with cross-functional teams (DevOps, Data Engineers, Developers).

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.