Overview
Skills
Job Details
NOTHIRD PARTIES PLEASE
Job Title: Kafka Platform Engineer
Summary:
Seeking an experienced Platform Engineer to architect, deploy, and manage Kafka-based solutions using Amazon MSK and Lenses. This role serves as the application owner for key third-party platforms and collaborates with internal teams and external vendors to ensure platform stability, scalability, and alignment with business needs.
Key Responsibilities:
Design and maintain high-availability Kafka clusters using Amazon MSK.
Monitor Kafka performance and optimize workflows with Lenses.
Implement BigID for data classification across AWS S3, RDS, and on-prem systems to support data governance.
Collaborate with developers, data engineers, and security teams to integrate and streamline data pipelines.
Develop automation tools and scripts (Python, Bash) for operational efficiency.
Provide expert-level troubleshooting and issue resolution for Kafka and platform-related incidents.
Drive continuous improvement by researching and applying emerging cloud and platform technologies.
Qualifications:
8+ years of experience in platform engineering or a related field.
Strong expertise with Amazon MSK, Kafka, and Lenses.
Proficient in scripting languages such as Python and Bash.
Experience with AWS cloud services.
Preferred Skills:
Strong problem-solving abilities and a proactive, analytical mindset.
Effective communicator with the ability to translate technical topics for diverse audiences.
Experience working in Agile environments and collaborating cross-functionally.