Senior Data DevOps Engineer

Description

We are seeking an experienced Sr. Data DevOps Engineer to support the Cyber Analytics Platform (CAP). You will play a critical role in designing, implementing and managing data solutions of a large-scale, multi-region data lake and analytics platform with the objective to empower the corporation to efficiently identify, detect, investigate, and respond to cyber threats.
Key Responsibilities:

• Design, implement, and manage scalable, secure, reliable and effective data solutions focus on streaming and event-driven logging using AWS services such as MSK (Managed Streaming for Apache Kafka), Lambda, EC2, ECS, Glue, S3, and Athena.
• Collaborate with cloud solution architects, network engineers, analysts, program managers, and other engineering teams to understand logging requirements and develop effective data ingestion, data analytics and reporting solutions
• Monitor and troubleshoot failure or performance issues in data solutions.

Requirements

• Design, implement, and manage scalable, secure, reliable and effective data solutions focus on streaming and event-driven logging using AWS services such as MSK (Managed Streaming for Apache Kafka), Lambda, EC2, ECS, Glue, S3, and Athena.
• Collaborate with cloud solution architects, network engineers, analysts, program managers, and other engineering teams to understand logging requirements and develop effective data ingestion, data analytics and reporting solutions
• Monitor and troubleshoot failure or performance issues in data solutions.

Qualifications:

• Bachelor s degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent experience.
• Proven experience as a DevOps Engineer, Data Engineer, or similar role, with a focus on data solutions.
• Strong experience in data ingestion, data modeling, data storage, ETL, and reporting, with a focus on streaming and event-driven logging using AWS services (MSK, Lambda, EC2, ECS, Glue, S3, etc).
• Proficiency in Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation.
• Experience with CI/CD tools and practices.
• Must Have Data Streaming Experience
• Experience with Syslog
• Familiarity with containerization technologies (e.g., Docker, Kubernetes) is a plus.
• Strong scripting skills in languages such as Python, Bash, or similar.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.
• Strong communication and collaboration skills, with the ability to work effectively in a team.