|
Job Summary
|
Senior Kafka Administrator responsible for managing and supporting large-scale on-prem Confluent/Kafka platforms, including cluster deployment, hardware refresh, migrations, performance tuning, reliability, automation, monitoring, and disaster recovery.
|
|
Key Responsibilities
|
· Design, deploy, and administer highly available Kafka/Confluent clusters.
· Manage topics, partitions, replication, retention, quotas, and consumer groups.
· Support Kafka Connect, Schema Registry, MirrorMaker/Confluent Replicator.
· Perform Kafka upgrades, patches, migrations, and hardware refreshes.
· Conduct performance tuning, capacity planning, benchmarking, and cluster right-sizing.
· Implement automation, monitoring, alerting, and incident-response processes.
· Develop DR, backup/restore, runbooks, and operational documentation.
· Support AWS MSK and cloud Kafka environments as needed.
· Provide knowledge transfer and documentation handoff
|
|
Required Qualifications
|
· 5+ years in Systems/Platform Engineering, SRE, or DevOps.
· 4+ years of hands-on Kafka administration in production environments.
· Strong knowledge of Kafka internals, partitions, replication, retention, compaction, and rebalancing.
· Hands-on experience with Kafka Connect, Schema Registry, and MirrorMaker/Replicator.
· Strong Linux, networking, and performance troubleshooting skills.
· Proficiency in automation/scripting.
· Experience with Datadog, Grafana, JMX, and log aggregation.
· Experience with DR, multi-region environments, and incident management.
· Strong technical documentation and communication skills.
· AWS MSK and hardware refresh/migration experience preferred.
|