Sr. Tech Lead-Kafka

Piper Companies is looking for a Senior Technical Lead-Kafka to join a financial services company based in King of Prussia, PA as they aim to enhance Kafka capabilities, ensuring it plays a vital role in their data architecture, stream processing, and data integration processes.

Key Responsibilities:

• Act as a subject matter expert in Kafka and associated tools.
• Collaborate with architecture teams to enhance Kafka's capabilities and drive its adoption across various projects.
• Lead initiatives to optimize Kafka clusters for maximum scalability, reliability, and performance.
• Implement Kafka-based stream processing solutions, leveraging Kafka Streams or other relevant technologies.
• Ensure Kafka's security controls meet industry standards and compliance requirements. Implement encryption, authentication, and authorization mechanisms.
• Establish robust monitoring and alerting systems for Kafka clusters.
• Oversee data ingestion pipelines, ensuring data is ingested efficiently and reliably into Kafka topics.

Qualifications:

• Proven experience with Kafka architecture, deployment, and management in large-scale environments.
• Expertise in stream processing, data pipelines, and Kafka Streams.
• Strong knowledge of Kafka security practices.
• Proficiency in performance tuning and Kafka monitoring.
• Experience with Kafka ecosystem tools and related technologies.
• Excellent communication and leadership skills and ability to work collaboratively with cross-functional teams.

Compensation/Benefits:

• Salary: $150,00-160,000
• Comprehensive benefit package; Medical, Dental, Vision, 401k, and Paid Time Off