Senior Kafka Engineer / Administrator


Microgreen Technologies LLC
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Kubernetes
- Linux
- Apache Flink
- Apache Kafka
- Amazon Web Services
- Terraform
- Migration
- ISR
- Semantics
- Python
- Confluent Platform
- Cloudera
- infrastructure engineering
- AWS MSK
- CI/CD
- GitLab
- Continuous Integration
Summary
Role: Senior Kafka Engineer / Administrator
Location: Denver, CO or St. Louis, MO
Work Arrangement: 4 days per week onsite. Candidates willing to relocate must be available to relocate from Day 1.
About the Role: We are migrating a portfolio of Apache Kafka clusters from on-premises platforms (Cloudera and Confluent) to AWS MSK, managed through a CI/CD pipeline built on Terraform and GitLab. We are looking for a senior, hands-on Kafka engineer to own day-to-day Kafka administration across both environments, drive the migration, and coordinate closely with producer and consumer application teams to ensure a smooth, low-risk cutover. This is a senior individual-contributor role for someone who has operated Kafka at scale in production, is comfortable in a hybrid on-premises/cloud environment and can serve as the technical point of contact between platform and application teams.
Required Qualifications
- 5+ years in data/platform/infrastructure engineering, with 4+ years operating Apache Kafka in production.
- Hands-on administration experience with Cloudera and Confluent Platform.
- Production experience with AWS MSK (provisioning, configuration, IAM authentication, and networking).
- Proven experience migrating Kafka workloads to the cloud with minimal disruption.
- Strong Terraform and GitLab CI/CD experience for infrastructure automation.
- Hands-on Datadog experience for monitoring, dashboards, and alerting.
- Deep understanding of Kafka internals: partitions, replication, ISR, offsets, consumer groups, and delivery semantics.
- Solid AWS fundamentals: VPC, security groups, IAM, KMS, CloudWatch, and PrivateLink.
- Strong Linux, networking, and scripting skills (Bash, Python).
- Excellent communication and coordination skills to work across producer/consumer teams.
Preferred / Nice to Have
- Experience with MirrorMaker 2, Confluent Replicator, or Cluster Linking.
- Schema Registry, Kafka Connect, and ksqlDB experience.
- Kafka Streams or Flink familiarity.
- Kubernetes / EKS experience (e.g., Strimzi).
- Certifications: Confluent Certified Administrator, AWS Solutions Architect/DevOps.
- Experience in regulated or large enterprise environments.
- Dice Id: 91109870
- Position Id: 9145560
- Posted 2 hours ago
Company Info
A great team is the sum of its people. We are looking for those who want to make a difference with their talents and are looking to grow and learn EVERY.SINGLE.DAY.
Do you consider yourself an innovator? Do you measure each day by what you have accomplished? Read more.
From our business analysts who help identify the next opportunity to partner and addess a healthcare problem to our data visualization and AI/ML engineers who are adept with the latest technologies to our client support specialists who make sure that we are meeting and exceeding expectations, each team member is vital and we want to grow together. Collaboration, respect, and great work-life balance are key in our work culture.
Irfan Md
Talent Acquisition Speacialist @ Microgreen Technologies LLC
