Sr. Middleware Engineer – Kafka

New York, NY, US • Posted 15 hours ago • Updated 15 hours ago

Contract W2

No Travel Required

On-site

$55 - $60/hr

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Architect
design
and implement Kafka-based solutions using Confluent Cloud and Confluent Platform
ensuring they are highly scalable
resilient
and future-proof. Provide technical leadership in designing event-driven architectures that integrate with on-prem systems and multiple cloud environments (AWS
Azure
or GCP). Platform Management Oversee administration and operational management of Confluent Platform components: Kafka brokers
Schema Registry
Kafka Connect
ksqlDB
and REST Proxy. Develop and maintain Kafka producers
consumers
and streams applications to support real-time data streaming use cases. Deployment & Automation Lead deployments and configurations of Kafka topics
partitions
replication strategies in both on-prem and cloud setups. Automate provisioning
deployment
and maintenance tasks with Terraform
Chef
Ansible
Jenkins
or similar CI/CD tools. Monitoring & Troubleshooting Implement robust monitoring
alerting
and observability frameworks using Splunk
Datadog
Prometheus
or similar tools for both Confluent Cloud and on-prem clusters. Proactively troubleshoot Kafka clusters
diagnose performance issues
and conduct root cause analysis for complex
distributed environments. Performance & Capacity Planning Conduct capacity planning and performance tuning to optimize Kafka clusters; ensure they can handle current and future data volumes. Define and maintain SLA/SLI metrics to track latency
throughput
and downtime. Security & Compliance Ensure secure configuration of all Kafka and Confluent components
implementing best practices for authentication (Kerberos/OAuth)
encryption (SSL/TLS)
and access control (RBAC). Collaborate with InfoSec teams to stay compliant with internal and industry regulations (GDPR
SOC
PCI
etc.). Cross-Functional Collaboration Work with DevOps
Cloud
Application
and Infrastructure teams to define and align business requirements for data streaming solutions. Provide guidance and support during platform upgrades
expansions
and new feature rollouts. Continuous Improvement

Summary

Sr. Middleware Engineer – Kafka
Client - Broadridge , NJ/NY

Primary Responsibilities
Architecture & Design
Architect, design, and implement Kafka-based solutions using Confluent Cloud and Confluent Platform, ensuring they are highly scalable, resilient, and future-proof.
Provide technical leadership in designing event-driven architectures that integrate with on-prem systems and multiple cloud environments (AWS, Azure, or Google Cloud Platform).
Platform Management
Oversee administration and operational management of Confluent Platform components: Kafka brokers, Schema Registry, Kafka Connect, ksqlDB, and REST Proxy.
Develop and maintain Kafka producers, consumers, and streams applications to support real-time data streaming use cases.
Deployment & Automation
Lead deployments and configurations of Kafka topics, partitions, replication strategies in both on-prem and cloud setups.
Automate provisioning, deployment, and maintenance tasks with Terraform, Chef, Ansible, Jenkins, or similar CI/CD tools.
Monitoring & Troubleshooting
Implement robust monitoring, alerting, and observability frameworks using Splunk, Datadog, Prometheus, or similar tools for both Confluent Cloud and on-prem clusters.
Proactively troubleshoot Kafka clusters, diagnose performance issues, and conduct root cause analysis for complex, distributed environments.
Performance & Capacity Planning
Conduct capacity planning and performance tuning to optimize Kafka clusters; ensure they can handle current and future data volumes.
Define and maintain SLA/SLI metrics to track latency, throughput, and downtime.
Security & Compliance
Ensure secure configuration of all Kafka and Confluent components, implementing best practices for authentication (Kerberos/OAuth), encryption (SSL/TLS), and access control (RBAC).
Collaborate with InfoSec teams to stay compliant with internal and industry regulations (GDPR, SOC, PCI, etc.).
Cross-Functional Collaboration
Work with DevOps, Cloud, Application, and Infrastructure teams to define and align business requirements for data streaming solutions.
Provide guidance and support during platform upgrades, expansions, and new feature rollouts.
Continuous Improvement
Stay current with Confluent Platform releases and Kafka community innovations.
Drive continuous improvement by recommending new tools, frameworks, and processes to enhance reliability and developer productivity.
Qualifications
Technical Expertise
5+ years of hands-on experience with Kafka; at least 2+ years focused on Confluent Cloud and Confluent Platform.
Deep knowledge of Kafka Connect, Schema Registry, Control Center, ksqlDB, and other Confluent components.
Experience architecting and managing hybrid Kafka solutions in on-prem and cloud (AWS, Azure, Google Cloud Platform).
Advanced understanding of event-driven architecture and the real-time data integration ecosystem.
Strong programming/scripting skills (Java, Python, Scala) for Kafka-based application development and automation tasks.
DevOps & Automation
Hands-on experience with Infrastructure as Code (Terraform, CloudFormation) for Kafka resource management in both cloud and on-prem.
Familiarity with Chef, Ansible, or similar configuration management tools to automate deployments.
Skilled in CI/CD pipelines (e.g., Jenkins) and version control (Git) for distributed systems.
Monitoring & Reliability
Proven ability to monitor and troubleshoot large-scale, distributed Kafka environments using Splunk, Datadog, Prometheus, or similar tools.
Experience with performance tuning and incident management to minimize downtime and data loss.
Security & Compliance
Expertise in securing Kafka deployments, including Kerberos and SSL configurations.
Understanding of IAM best practices, network security, encryption, and governance in hybrid environments.
Leadership & Collaboration
Demonstrated experience leading platform upgrades, migrations, and architecture reviews.
Excellent communication skills, with ability to articulate complex technical concepts to diverse audiences (developers, architects, executives).
Comfortable collaborating with cross-functional teams—product owners, system engineers, security, and business stakeholders.
Education & Preferred Experience
Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field (or equivalent experience).
Experience with container orchestration (Docker/Kubernetes) is a plus.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91142794
Position Id: 8910051
Posted 15 hours ago

Company Info

About SSTech LLC

SSTech LLC specializes in IT consulting, focusing on understanding client needs and providing skilled professionals to meet those requirements. Whether it’s through project-based consulting, staff augmentation, or full-scale IT solutions, the firm likely works closely with clients to identify technology gaps and deliver the right talent and expertise.

SSTech LLC is a dynamic and rapidly growing IT staffing and consulting firm headquartered in Irving, TX. With years of experience in the industry, we specialize in delivering innovative technology solutions and augmenting our clients’ IT teams with top-tier professionals. We pride ourselves on our commitment to integrity, honesty, and excellence in service.

Founded on the core values of integrity, technological insight, and customer satisfaction, SSTech LLC has built a reputation for providing reliable, high-quality IT staffing solutions. Our team works closely with clients to understand their unique needs and ensure that the right talent is deployed at the right time, empowering businesses to achieve their technology goals.Whether you’re looking to expand your IT staff, implement a cutting-edge technology solution, or need specialized expertise for a critical project, SSTech LLC is your trusted partner in success

SSTech LLC provides premier IT staffing services designed to help businesses develop and deploy innovative IT solutions that reduce costs and enhance performance across large enterprises worldwide. Our primary focus is on building mission-critical business applications engineered for optimal performance, scalability, and reliability.

With a deep understanding of the complexities facing modern enterprises, SSTech LLC ensures that our IT solutions not only meet the current needs of our clients but are also flexible and scalable to adapt to future demands. We specialize in delivering high-performance systems that are built to scale predictably, while maintaining the highest levels of reliability, security, and efficiency.

Whether you’re looking to streamline operations, enhance productivity, or develop cutting-edge applications, SSTech LLC is your trusted partner for building technology solutions that power business success on a global scale.

We are driven by core value and we are confident that when you select us as your IT Business Solutions Partner, we help businesses to move forward , faster by combining deep industry experience and frictionless technology delivery. Businesses today require transformational change at a scale and speed that defies traditional ways of working. We spark change through our digital transformation hub that delivers deep digital engineering and industry expertise through client-specific and integrated agile scrum teams.The SSTech LLC team is focused on delivering customer satisfaction by providing world-class IT services to the dynamic and developing high-technology market

SSTech LLC is a dynamic and fast growing company with headquarters in Dallas, Texas, USA. Through close relationships with partners , SSTech LLC has an extended presence in India.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Senior Middleware Engineer

New York, New York

•

Today

Sr. Middleware Engineer Kafka , NJ/NY Primary Responsibilities 1. Architecture & Design o Architect, design, and implement Kafka-based solutions using Confluent Cloud and Confluent Platform, ensuring they are highly scalable, resilient, and future-proof. o Provide technical leadership in designing event-driven architectures that integrate with on-prem systems and multiple cloud environments (AWS, Azure, or Google Cloud Platform). 2. Platform Management o Oversee administration and operati

Easy Apply

Contract, Third Party

65 - 70

Search all similar jobs