Overview
Skills
Job Details
Join a forward-thinking team dedicated to building and scaling a cutting-edge, ephemeral, and immutable Data and Machine Learning platform on AWS. We leverage modern technologies, including Databricks, Terraform, Python, and GitHub Actions, to create a fully automated environment with robust CI/CD pipelines. Our mission is to provide the core enterprise platform that powers data analytics and AI innovation across the organization.
About the RoleWe are seeking a highly skilled Platform Engineer to help us design, build, and maintain our core Data & ML platform. In this role, you will play a crucial part in developing new capabilities, ensuring security and compliance, and enhancing the platform to meet the evolving needs of our users. The ideal candidate is a strong software engineer with a passion for automation, data, and building resilient, scalable systems.
What You'll Do- Platform Development: Design and implement new features for our Databricks-based platform, staying current with industry trends and advancements in AI.
- Core Component Implementation: Test and integrate central platform components that support our technology stack and serve tenants across the organization.
- Collaboration: Partner with other engineering teams to identify and deliver platform enhancements that solve specific business problems.
- Maintain Excellence: Uphold strict security protocols, compliance controls, and architectural principles in all aspects of your work.
Core Qualifications:
- A bachelor s degree in Computer Science or a related field, with 8+ years of experience in software engineering.
- A proven track record of designing and building complex, multi-tenant
- Excellent problem-solving abilities and a strong drive for engineering
- A mindset geared towards automation over manual
- The confidence to challenge ideas constructively and ask insightful
- Platform & Software Engineering: Deep understanding of modern software engineering principles, platform engineering, and cloud-native design patterns (especially AWS). Expertise in microservices architecture is a plus.
- Data Engineering & Architecture: Strong background in both batch and real-time data pipeline development and modern data architecture.
- CI/CD & Automation: Extensive experience designing and implementing CI/CD pipelines (preferably with GitHub Actions) and a strong command of Infrastructure as Code (Terraform, YAML).
- Primary Tech Stack:
- Databricks: Strong expertise, including in-depth knowledge of data lakes and data warehouse architecture.
- AWS: Comprehensive knowledge of native data services and cloud
- Python: Advanced knowledge of object-oriented principles and
- Terraform: Advanced knowledge and extensive experience in building IaaC
- Observability: Operational experience with monitoring, logging, and alerting tools and best
- Source Control: Proficiency with tools like GitHub