Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)
Skills
Kafka Admin
Job Details
The following requirement is open with our client.
Title : Kafka Admin
Location : New York, NY (Onsite)
Duration : 12+ Months
Visa Status : H1B
Job Description
- Creating and managing Kafka topics, partitions, and replication factors.
- Monitoring consumer lag and ensuring timely message delivery.
- Implementing and managing schema registry for data consistency.
- Developing and maintaining data pipelines for real-time data streaming and processing.
- Troubleshooting issues related to Kafka brokers, topics, and data flow.
- Configuring and managing access control lists (ACLs) for Kafka topics.
- Implementing and managing disaster recovery plans for Kafka clusters.
- Participating in the design and architecture of Kafka-based systems.
- Staying up-to-date on the latest Kafka features, best practices, and security recommendations.
- Kafka Cluster Management: Installing, configuring, and maintaining Kafka brokers, Zoo Keeper, and other related components.
- Monitoring and Performance Optimization: Monitoring Kafka cluster health, performance metrics, and resource utilization using tools like Confluent Control Center, Grafana, or others.
- Troubleshooting and Issue Resolution: Diagnosing and resolving issues related to Kafka brokers, topics, partitions, consumer/producer configurations, and data flow.
- Security Management: Implementing and managing security protocols, including authentication (e.g., SASL, SSL/TLS) and authorization (e.g., ACLs).
- Capacity Planning and Scaling: Assessing resource requirements, planning for future capacity, and scaling clusters to handle increasing workloads.
- Data Pipeline Design and Implementation: Developing and maintaining data pipelines using Kafka Connect, Kafka Streams, or other relevant technologies.
- Collaboration and Communication: Working with development, operations, and other teams to ensure smooth integration and operation of Kafka within the broader ecosystem.
- Automation: Developing and maintaining automation scripts and tools for deployment, configuration, and maintenance tasks using tools like Ansible, Jenkins, or Python.
- Documentation: Creating and maintaining documentation for Kafka configurations, procedures, and best practices.
- A Kafka Admin is responsible for managing and maintaining Kafka clusters, ensuring high availability, performance, and security.
- Their duties include installing, configuring, monitoring, and troubleshooting Kafka clusters and related infrastructure.
- They also design and implement data pipelines, manage topics and partitions, and collaborate with other teams to integrate Kafka with other systems.
Must Have:
Kafka Admin
Thanks & Regards
Prasanna M
Technical Recruiter
ASCII Group, LLC
38345 W 10 Mile Rd, Suite 365, Farmington, MI 48335, US Mobile:
Email: | Website:
LinkedIn :
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.