Overview
Skills
Job Details
Key Responsibilities:
- Design, implement, and manage scalable, secure, reliable and effective data solutions focus on streaming and event-driven logging using AWS services such as MSK (Managed Streaming for Apache Kafka), Lambda, EC2, ECS, Glue, S3, and Athena.
- Collaborate with cloud solution architects, network engineers, analysts, program managers, and other engineering teams to understand logging requirements and develop effective data ingestion, data analytics and reporting solutions
- Monitor and troubleshoot failure or performance issues in data solutions.
Requirements
- Design, implement, and manage scalable, secure, reliable and effective data solutions focus on streaming and event-driven logging using AWS services such as MSK (Managed Streaming for Apache Kafka), Lambda, EC2, ECS, Glue, S3, and Athena.
- Collaborate with cloud solution architects, network engineers, analysts, program managers, and other engineering teams to understand logging requirements and develop effective data ingestion, data analytics and reporting solutions
- Monitor and troubleshoot failure or performance issues in data solutions.
Qualifications:
- Bachelor s degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent experience.
- Proven experience as a DevOps Engineer, Data Engineer, or similar role, with a focus on data solutions.
- Strong experience in data ingestion, data modeling, data storage, ETL, and reporting, with a focus on streaming and event-driven logging using AWS services (MSK, Lambda, EC2, ECS, Glue, S3, etc).
- Proficiency in Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation.
- Experience with CI/CD tools and practices.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes) is a plus.
- Strong scripting skills in languages such as Python, Bash, or similar.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
- Strong communication and collaboration skills, with the ability to work effectively in a team.