Kafka Admin/Kafka Administrator/Kafka Consultant/Kafka Engineer

  • New York, NY
  • Posted 1 day ago | Updated 21 hours ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2

Skills

Kafka
Apache
API
APIs
API's
Messaging
Shell
Python
Ansible

Job Details

Job Title: Kafka Administrator

Location: New York, NY

Duration: Long Term

Job Responsibilities:

  • We are seeking an experienced Kafka Administrator to join our infrastructure team in New York.
  • The ideal candidate will have 6+ years of hands-on experience in managing, configuring, and optimizing Apache Kafka in enterprise environments.
  • This role requires strong expertise in Kafka architecture, monitoring, security, and performance tuning, along with a solid understanding of distributed systems and real-time data pipelines.

Key Responsibilities:

  • Install, configure, and maintain Kafka clusters, brokers, topics, and zookeepers.
  • Monitor Kafka system performance, availability, and capacity planning.
  • Implement security best practices including authentication (Kerberos/SSL) and authorization (ACLs).
  • Perform routine maintenance, upgrades, and patching of Kafka components.
  • Troubleshoot issues with Kafka producers, consumers, and stream processing.
  • Develop scripts and tools for automation using Shell, Python, or Ansible.
  • Work closely with development and DevOps teams to support Kafka-based applications and data flows.
  • Create and maintain documentation for Kafka environments and standard operating procedures.
  • Ensure high availability and disaster recovery configurations for critical Kafka infrastructure.

Required Skills:

  • 6+ years of experience in Kafka administration and distributed messaging systems.
  • Proficiency with Kafka ecosystem tools (Kafka Connect, MirrorMaker, Schema Registry, etc.).
  • Experience with Zookeeper management and configuration.
  • Strong knowledge of Linux system administration.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.