Kafka Engineer

Job Role: Kafka Full stack Engineer

Location: Louisville, KY/ Remote

Job Description:

Must Have Technical/Functional Skills

Hands-on experience in Confluent Kafka:

• Experienced in setting up the configuration, security, and monitoring of Confluent Kafka components: brokers, zookeeper, control center, schema registry, and connect clusters.
• Experienced in the development of infrastructure solutions for publisher/consumer tenants, enabling robust multi-tenant cloud services.
• Experience in Microsoft Azure / Google Cloud Platform (Google Cloud Platform)
• Experienced in Dot Net tech stack
• Strong experience in .NET (C#) development for API design and implementation
• Proficiency with Azure cloud services, particularly Event Hub, Logic Apps (Workflows), Azure Kubernetes services (AKS), and Azure Functions (both .NET and Java implementations)
• RESTful services
• Familiarity with authentication, authorization, and security best practices for APIs.
• Micro services Architecture
• Windows console apps and Services
• Proficient in SQL and PostgreSQL Database
• Hands-on experience on CI/CD tools (Azure DevOps, GitHub)
• Good understanding on terraform scripting, building pipelines and releases

Roles & Responsibilities

• Set up and configure Kafka clusters, components like brokers, zookeeper, control center, schema registry, and connect clusters.
• Monitor cluster health and performance.
• Create, delete, and configure Kafka topics.
• Manage broker configurations and ensure high availability.
• Diagnosing and resolve issues related to data flow, broker failures, and consumer lag.
• Integrate Kafka with other systems/services (e.g., Azure/Google Cloud Platform services, restful APIs, databases, microservices etc).
• Provide support for Kafka-related issues in production. (Azure DevOps / GitHub). Experience working in agile development projects and sprint delivery
• Design, develop, and maintain web applications using .Net technologies across both front-end and back-end integrating with Confluent Platform.
• Implement responsive user interfaces and ensure seamless integration with backend services.
• Optimize application performance and ensure code quality through unit testing and code reviews.
• Develop and maintain cloud-based solutions, leveraging platforms such as Azure or Google Cloud Platform.
• Integrate and manage event-driven architectures using Confluent Kafka for scalable message streaming and processing.
• Monitor and troubleshoot Confluent Kafka clusters and cloud resources to ensure high availability and reliability.
• Automate deployment pipelines and manage CI/CD processes for efficient application delivery.
• Implement infrastructure as code and configuration management using relevant DevOps tools.
• Collaborate with development and operations teams to enhance system scalability, security, and monitoring.
• Individual contributor and problem solver