Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - 6 Month(s)
No Travel Required
Skills
Databricks
Real-time
Terraform
Design Patterns
Python
Job Details
About the Role
We are seeking a highly skilled Platform Engineer to help us design, build, and maintain our core Data & ML platform. In this role, you will play a crucial part in developing new capabilities, ensuring security and compliance, and enhancing the platform to meet the evolving needs of our users. The ideal candidate is a strong software engineer with a passion for automation, data, and building resilient, scalable systems.
What You'll Do
- Platform Development: Design and implement new features for our Databricks-based platform, staying current with industry trends and advancements in AI.
- Core Component Implementation: Test and integrate central platform components that support our technology stack and serve tenants across the organization.
- Collaboration: Partner with other engineering teams to identify and deliver platform enhancements that solve specific business problems.
- Maintain Excellence: Uphold strict security protocols, compliance controls, and architectural principles in all aspects of your work.
Technical Expertise:
- Platform & Software Engineering: Deep understanding of modern software engineering principles, platform engineering, and cloud-native design patterns (especially AWS). Expertise in microservices architecture is a plus.
- Data Engineering & Architecture: Strong background in both batch and real-time data pipeline development and modern data architecture.
- CI/CD & Automation: Extensive experience designing and implementing CI/CD pipelines (preferably with GitHub Actions) and a strong command of Infrastructure as Code (Terraform, YAML).
- Primary Tech Stack:
- Databricks: Strong expertise, including in-depth knowledge of data lakes and data warehouse architecture.
- AWS: Comprehensive knowledge of native data services and cloud architecture.
- Python: Advanced knowledge of object-oriented principles.
- Terraform: Advanced knowledge and extensive experience in building IaaC systems.
- Observability: Operational experience with monitoring, logging, and alerting tools and best practices.
- Source Control: Proficiency with tools like GitHub.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.