Overview
On Site
$100,000 - $130,000
Full Time
Skills
Apache Kafka
Kafka
Apache Hadoop
Apache Spark
Apache Storm
Big Data
Hadoop
Spark
Storm
BigData
Python
Data Processing
Management
administrator
admin
Job Details
Job Role: Kafka Admin Engineer
Location: New York, NY
Job Description:
Must Have Technical/Functional Skills
- Designing, developing, and managing Kafka-based data pipelines.
- Working with other big data technologies such as Hadoop, Spark, and Storm.
- Monitoring and optimizing Kafka clusters.
- Troubleshooting Kafka related issues.
- Performing 3rd level administrator support for Kafka infrastructure.
- Maintaining the availability, performance and security of Kafka infrastructure.
- Creating and managing Kafka topics, producers, consumers, and Python-based Kafka consumers and producers to enable efficient data processing with other systems.
Roles & Responsibilities
- Handling customer queries and support.
- Ensuring support availability during agreed business hours.
- Ensuring 24/7 support availability during the rotational service guard period.
- Developing and maintaining the automation for Kafka infrastructure.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.