Kafka Administrator (MS Azure)/Apache Kafka Administrator/Kafka Administrator Microsoft Azure

Job Description:

We are seeking a highly skilled Kafka Administrator with strong Microsoft Azure expertise to support and optimize our streaming data platform. The ideal candidate will have deep experience in distributed systems, Kafka cluster management, and cloud-based data engineering, with a strong focus on performance, scalability, and reliability.

Key Responsibilities:

• Manage Kafka clusters including provisioning, configuration, scaling, and maintenance
• Integrate Kafka with Azure services such as Event Hubs and Azure Data Lake Storage
• Optimize Kafka performance including broker configurations, partitioning strategies, and JVM tuning
• Implement and maintain Kafka security, governance, and compliance standards
• Automate infrastructure deployment using Terraform across Dev, UAT, and Production environments
• Monitor and troubleshoot issues such as consumer lag, rebalance storms, and disk pressure
• Design and implement disaster recovery strategies using MirrorMaker 2 or Cluster Linking
• Collaborate with cross-functional teams to ensure reliable data streaming architecture