Data Systems Engineer - ELK/Kafka/Linux and streaming data

Introduction

As a Data Systems Engineer specializing in ELK/Kafka/Linux, you will play a crucial role in our team by managing and optimizing data systems to ensure efficient and effective data processing and analysis. You will work with cutting-edge technologies like ELK and Kafka to build pipelines and enhance data infrastructure.

Responsibilities

• Develop and maintain data pipelines using ELK and Kafka
• Optimize data processing systems for improved performance and scalability
• Collaborate with cross-functional teams to integrate data systems with existing infrastructure
• Troubleshoot and debug data system issues on Linux platforms
• Implement best practices for data security and compliance
• Document system configurations and processes for future reference

Requirements

• 5 years of coding experience with at least one of the languages: Python, Ruby, Java, C/C++, GO
• Strong working knowledge of the Linux platform
• Experience in application development, especially with Python, Ruby, or Shell scripting
• Ability to debug and optimize applications running on Linux
• Proficiency in ELK (Elastic Search) for data processing and analysis
• Experience in building data pipelines with Kafka