Kafka SME Architect/(Onsite role)
Location- Houston, TX
Duration: Long term
JD:
· Design, implement, and maintain Kafka-based integration solutions for real-time and
batch data exchange.
· Develop and manage interfaces between Kafka and third-party systems, ensuring reliability, scalability, and security.
· Work closely with technical teams to integrate Kafka with Endur, leveraging knowledge of Endur tables and common integration patterns.
· Troubleshoot and optimize Kafka clusters, topics, and consumer/producer configurations.
· Ensure high availability and fault tolerance in Kafka environments.
· Collaborate with architecture and development teams to define best practices for data streaming and integration.
· Provide technical guidance and mentorship on Kafka-related projects.
Your Skills & Experience:
· Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field (or equivalent experience).
· Strong hands-on experience with Apache Kafka, including cluster setup, configuration,and performance tuning.
· Proven track record of building and managing integrations with third-party systems using Kafka.
· Experience integrating with Endur, specifically understanding its database tables and integration patterns.
· Solid understanding of data streaming concepts, event-driven architecture, and messaging systems.
· Proficiency in Java, Python, or similar programming languages for Kafka client development.
· Familiarity with schema management (Avro, Protobuf), Kafka Connect, and Kafka Streams.
· Knowledge of monitoring and troubleshooting tools for Kafka (e.g., Confluent Control Center, Prometheus, Grafana).
· Strong problem-solving skills and ability to work in a fast-paced environment.
Nice-to-Have
· Experience with cloud-based Kafka deployments (AWS MSK, Confluent Cloud, etc.).
· Knowledge of CI/CD pipelines and DevOps practices for Kafka deployments.