Lead Infrastructure Databricks Engineer with Kubernets, AWS, CI/CD Automation

Location: Remote (Should work in Pacific Time Zone)

Job Description:

• 10+ years of experience
• Deep Technical Expertise: 5+ years building and operating large-scale cloud platforms, with at least 2+ years in a data-focused DevOps/SRE role.
• AWS Implementation Experience: Hands-on experience with AWS services (networking, IAM, security) and proven ability to manage multi-account environments.
• Infrastructure as Code: Strong Terraform skills for multi-stack, multi-environment setups, applying modular design and best practices.
• CI/CD Automation: Demonstrated success in building and optimizing CI/CD pipelines (GitHub Actions, Jenkins) for applications, infrastructure, and data workflows.
• Must have Databricks Expertise: Practical experience with the full Databricks Lakehouse Platform, including Unity Catalog, Delta Lake, and MLflow.
• Kubernetes Operations: Experience administering Kubernetes clusters—deploying workloads via kubectl and Helm, configuring observability, and troubleshooting issues.

Nice to Have:

• AWS DevOps or Solutions Architect associate/professional Certification
• Certified Kubernetes Administrator (CKA)
• Terraform Certification