Lead Aws Cloud Data Engineer

Remote contarct
Must have - Big data streaming pipelines (e.g. MSK, ECS, Lambda) Exp

Description

We are seeking an experienced Sr. Data DevOps Engineer to support the Cyber Analytics Platform (CAP). You will play a critical role in designing, implementing and managing data solutions of a large-scale, multi-region data lake and analytics platform with the objective to empower the corporation to efficiently identify, detect, investigate, and respond to cyber threats. Key Responsibilities:

- Design, implement, and manage scalable, secure, reliable and effective data solutions focus on streaming and event-driven logging using AWS services such as MSK (Managed Streaming for Apache Kafka), Lambda, EC2, ECS, Glue, S3, and Athena.

- Collaborate with cloud solution architects, network engineers, analysts, program managers, and other engineering teams to understand logging requirements and develop effective data ingestion, data analytics and reporting solutions

- Monitor and troubleshoot failure or performance issues in data solutions.

Requirements

- Design, implement, and manage scalable, secure, reliable and effective data solutions focus on streaming and event-driven logging using AWS services such as MSK (Managed Streaming for Apache Kafka), Lambda, EC2, ECS, Glue, S3, and Athena.

- Collaborate with cloud solution architects, network engineers, analysts, program managers, and other engineering teams to understand logging requirements and develop effective data ingestion, data analytics and reporting solutions

- Monitor and troubleshoot failure or performance issues in data solutions.

Qualifications:

- Bachelor s degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent experience.

- Proven experience as a DevOps Engineer, Data Engineer, or similar role, with a focus on data solutions.

- Strong experience in data ingestion, data modeling, data storage, ETL, and reporting, with a focus on streaming and event-driven logging using AWS services (MSK, Lambda, EC2, ECS, Glue, S3, etc).

- Proficiency in Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation.

- Experience with CI/CD tools and practices.

- Familiarity with containerization technologies (e.g., Docker, Kubernetes) is a plus.

- Strong scripting skills in languages such as Python, Bash, or similar.

- Excellent problem-solving skills and the ability to work in a fast-paced environment.

- Strong communication and collaboration skills, with the ability to work effectively in a team.

Preferred Qualifications:

- Experience in cybersecurity domain.

- Experience with SIEM solutions, such as Microsoft Sentinel

- Knowledge in managing data security, compliance, and monitoring using AWS services (KMS, IAM, CloudWatch, etc.)