Kafka Administrator

Title: Kafka Administrator Location: New York City, NY (Onsite) Position: Contract

Required:
A Kafka Administrator is responsible for the installation configuration management and monitoring of Apache Kafka clusters ensuring high availability security and optimal performance
They manage the Kafka environment including brokers topics and partitions and work with other teams to integrate Kafka with various systems
Kafka Cluster Management Installing configuring and maintaining Kafka clusters including high availability and disaster recovery strategies
Performance Optimization Monitoring performance identifying bottlenecks and fine-tuning Kafka for optimal throughput and latency
Security Management Implementing and managing security configurations including access control authentication and encryption
Monitoring and Alerting Setting up and maintaining monitoring and alerting systems to proactively identify and address issues
Troubleshooting Diagnosing and resolving issues within the Kafka ecosystem including performance problems connectivity issues and data related problems
Integration Collaborating with development and other teams to integrate Kafka with other systems and applications including data ingestion and real-time data streaming
Documentation Creating and maintaining documentation for Kafka configurations processes and procedures
Automation Automating routine tasks and developing scripts to streamline cluster management
Capacity Planning Assessing current and future resource needs to ensure the Kafka environment can scale effectively