Kafka SME Architect (Endur)

Overview

Hybrid
$65 - $75
Contract - W2
Contract - 6 Month(s)

Skills

Kafka and Endur integration
oil & gas experience
Java
Python
schema management
cloud-based Kafka deployments

Job Details

Could you be a good fit?
We are looking for the best, highly skilled Kafka Subject Matter Expert (SME) to join the team of our exceptional client. This role focuses on managing integrations and interfaces with third-party systems, with deep technical expertise in Apache Kafka and experience integrating with Endur.

This position requires hands-on Kafka experience, strong programming skills, and the ability to troubleshoot, optimize, and maintain reliable, scalable, and secure data streaming solutions.

Benefits:
Hybrid or onsite schedule
Healthcare Medical, Dental, and Vision Insurance
401k

What will your day look like?
As a Kafka SME, you will:
Design, implement, and maintain Kafka-based integration solutions for real-time and batch data exchange.
Develop and manage interfaces between Kafka and third-party systems to ensure reliability, scalability, and security.
Integrate Kafka with Endur, leveraging knowledge of its tables and common integration patterns.
Troubleshoot and optimize Kafka clusters, topics, and consumer/producer configurations.
Ensure high availability and fault tolerance across Kafka environments.
Collaborate with architecture and development teams to define best practices for data streaming and integrations.
Provide technical guidance and mentorship on Kafka-related projects.

You will be a good fit for the Kafka SME role if you have:
Bachelor s or Master s degree in Computer Science, IT, or related field (or equivalent experience)
Strong hands-on experience with Apache Kafka, including cluster setup, configuration, and performance tuning
Proven experience building and managing integrations with third-party systems using Kafka
Experience integrating with Endur, with understanding of its database tables and integration patterns
Solid understanding of data streaming concepts, event-driven architecture, and messaging systems
Proficiency in Java, Python, or similar programming languages for Kafka client development
Familiarity with schema management (Avro, Protobuf), Kafka Connect, and Kafka Streams
Knowledge of monitoring and troubleshooting Kafka with tools like Confluent Control Center, Prometheus, or Grafana
Strong problem-solving skills and ability to work in a fast-paced environment

Nice-to-Haves:
Experience with cloud-based Kafka deployments (AWS MSK, Confluent Cloud, etc.)
Knowledge of CI/CD pipelines and DevOps practices for Kafka deployments
Familiarity with energy trading systems and related integration patterns

About Market Street Talent
We are a specialized staffing and consulting firm focused on IT and technology positions. Our deep industry knowledge allows us to match exceptional candidates with organizations where they can thrive and make an immediate impact.

Our Vision: To promote and foster the growth of information technology (IT) in our world one candidate, one client, one community at a time.
Our Goal: To guide clients and candidates through the placement process and build long-term, successful relationships.
Our Culture: At MST, we value excellence, respect, and empathy in everything we do.

Sound like you? Ready for your next challenging IT opportunity? Click Apply Now !

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.