Kafka Platform Engineer
Columbus OH (Onsite)
Kafka & Confluent - Apache Kafka architecture and administration, Kafka Producers and Consumers, Kafka Connect, Schema Registry, Stream Governance, Kafka topic design and partitioning strategies.
Cloud Platforms - Experience with Microsoft Azure Integration Technologies - REST APIs, Event-driven architecture, Microservices integration, Data streaming platforms Security - SASL/SSL, Oauth, RBAC, API Key management DevOps – Terraform, GitHub/GitLab/Azure DevOps, CI/CD pipelines, Infrastructure as Code
· Design and implement Confluent Cloud environments across Development, QA, UAT, and Production.
· Configure Kafka clusters, topics, partitions, replication policies, and retention settings.
· Establish environment standards, naming conventions, and deployment procedures.
· Implement multi-region and disaster recovery strategies where required.
· Integrate applications, databases, cloud services, and enterprise systems with Kafka.
· Configure and manage Confluent Cloud connectors.
· Implement event-driven architecture and streaming integration patterns.
· Monitor platform health, throughput, consumer lag, and broker utilization.
· Troubleshoot producer, consumer, and connectivity issues.
· Configure alerts and operational dashboards.
· Support platform upgrades, performance tuning, and capacity planning.
· Automate Kafka infrastructure deployment using Infrastructure as Code (Terraform preferred).
· Integrate Kafka deployments into CI/CD pipelines.
· Collaborate with enterprise architects, integration teams, cloud engineers, and business stakeholders.
· Conduct technical design reviews and architecture discussions.