Kafka Infrastructure Administrator - Kraft, CFK, Zookeeper, and Control Center

Overview

Hybrid
$160,000 - $170,000
Full Time

Skills

Ansible
Apache Kafka
Middleware
Apache ZooKeeper

Job Details

NO SPONSORSHIP - NO OPT

Lead Associate Principal, Software Engineering: Middleware Kafka

Keys: Kraft, CFK, Zookeeper, and control center.

Terraform & Ansible are nice to haves, just need to be familiar with them

Sharp, seasoned, administrator with medium experience in Terraform and Ansible

We are seeking a highly skilled and experienced Infrastructure Middleware Engineer with deep expertise in Kafka administration, infrastructure as code (IaC), cloud automation, container orchestration and CI/CD pipelines. The ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable middleware solutions, ensuring high availability, performance, and security. You will play a crucial role in automating infrastructure provisioning, deployments, and operations, enabling our organization to rapidly deliver and scale applications.

Primary Duties and Responsibilities:

  • Design, implement and manage highly available and scalable Kafka clusters.
  • Monitor Kafka performance, troubleshoot issues and optimize configurations.
  • Stay updated on the latest industry trends and best practices in Confluent Kafka development.
  • Troubleshoot and resolve any technical issues related to Kafka implementations.
  • Work closely with cross-functional teams to ensure successful delivery of projects within agreed timelines.
  • Participate in code reviews and provide constructive feedback to improve solution quality.
  • Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration Management.
  • Create and maintain reusable IaC modules.
  • Design and implement cloud-based infrastructure solutions on AWS and Azure.
  • Automate cloud resource provisioning, scaling and management using cloud-native tools and services.
  • Deploy and Manage containerized applications using Kubernetes and Rancher
  • Troubleshoot container-related issues and optimize container performance.
  • Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins.
  • Automated the build, test and deployment of middleware components.
  • Integrate IaC and container technologies into CI/CD pipelines.
  • Document all processes and procedures.
  • Work with development teams to ensure smooth deployments.

Qualifications:

  • Strong proficiency in IaC tools, specifically Ansible, Terraform and bash scripting.
  • Extensive experience with cloud automation and provisioning on AWS and Azure.
  • Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins.
  • Strong scripting skills in languages like Python and Bash.
  • Excellent troubleshooting and problem-solving skills
  • Understanding of networking principles.
  • Experience with monitoring tools like Splunk, Splunk OTEL, Prometheus and Grafana.

Technical Skills:

  • Knowledge and experience with Kraft, CFK, Zookeeper and control center is a must
  • Kafka, Ansible, Terraform, Bash, Kubernetes, Rancher, GitHub, Artifactory, Harness, Jenkins, AWS, Azure, CI/CD, IaC, Automated Cloud Provisioning
  • Continuously improve and optimize Kafka solutions to enhance performance and scalability.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.