Databricks Platform Engineer

Overview

On Site
Full Time

Skills

Artificial Intelligence
Cloud Computing
Advanced Analytics
Scalability
Data Engineering
Data Science
Analytics
Lifecycle Management
GitLab
Bash
Dashboard
Access Control
Regulatory Compliance
Unity
Data Security
Machine Learning (ML)
Analytical Skill
Innovation
Mentorship
Incident Management
SAP BASIS
Law
Financial Services
Blogging
Computer Science
Information Systems
System Administration
Data Lake
Storage
IaaS
Resource Management
Computer Networking
Scripting
Terraform
Command-line Interface
Windows PowerShell
Python
RESTful
SQL
Provisioning
Management
Continuous Integration
Continuous Delivery
Version Control
Git
GitHub
Workflow
Performance Tuning
Microsoft Azure
Databricks
Optimization
Apache Kafka
ELT
Snow Flake Schema
Agile
Collaboration
Communication
Articulate
Leadership
Marketing Operations
Taxes

Job Details

Opportunity Overview

About the Opportunity
Are you passionate about enabling advanced analytics, data science, and AI? Do you thrive at the intersection of cloud engineering and transformative business initiatives? If so, the Data Platform Engineering team is seeking an experienced Databricks Platform Engineer to help drive our enterprise data modernization strategy. This unique opportunity positions you at the forefront of our mission to accelerate advanced analytics, data science, and machine learning across the enterprise by building, managing, and evolving our Databricks platform on Azure.

As a Databricks Platform Engineer , you will architect, implement, and optimize our Azure Databricks environment, supporting mission-critical analytics projects across multiple business units. You'll directly enable high-value initiatives while enhancing platform reliability, scalability, and governance. You will collaborate with data engineering, data science, analytics, and application teams to empower business innovation, drive technical excellence, and support key transformation initiatives.

What you will do:
  • Platform Architecture & Management: Design, implement, and manage scalable, secure Databricks platforms including workspace/cluster provisioning, lifecycle management, and resource optimization using Delta Lake and Photon to ensure performance, reliability, and cost efficiency.
  • Infrastructure Automation & Monitoring: Automate provisioning and deployment using Terraform, GitLab CI/CD, and scripting (Python, Bash, PowerShell) while building observability dashboards to monitor platform health, performance, and costs.
  • Security & Governance: Implement and enforce security policies, access controls, and compliance requirements using Unity Catalog and Databricks security features to maintain enterprise-grade data protection.
  • Collaboration & Troubleshooting: Partner with data scientists, ML engineers, and product teams to deploy data pipelines and analytical services while resolving cluster configuration issues, job failures, and performance bottlenecks.
  • Platform Innovation & Support: Evaluate and adopt emerging Databricks capabilities, document architecture and best practices, mentor junior engineers, and participate in on-call rotation for rapid incident response and platform stability.
  • You will also participate in the Databricks platform on-call support rotation, providing expert assistance and rapid response for high-priority incidents, escalations, and critical service interruptions. This is a vital component of our commitment to platform stability and end-user success.

EEO Statement

Edward Jones does not discriminate on the basis of race, color, gender, religion, national origin, age, disability, sexual orientation, pregnancy, veteran status, genetic information or any other basis prohibited by applicable law.

Company Description

Join a financial services firm where your contributions are valued. Edward Jones is a Fortune 500 company where people come first. With over 9 million clients and 20,000 financial advisors across the U.S. and Canada, we're proud to be privately-owned, placing the focus on our clients rather than shareholder returns.

Behind everything we do is our purpose: We partner for positive impact to improve the lives of our clients and colleagues, and together, better our communities and society. We are an innovative, flexible, and inclusive organization that attracts, develops, and inspires performance excellence and a sense of belonging.

People are at the center of our partnership. Edward Jones associates are seen, heard, respected, and supported. This is what we believe makes us the best place to start or build your career.

View our Purpose, Inclusion and Citizenship Report.

Fortune 500, published June 2024, data as of December 2023. Compensation provided for using, not obtaining, the rating.

Awards and Accolades

At Edward Jones, we are building a place where everyone feels like they belong. We're proud of our associates' contributions to the firm and the recognitions we have received.

Check out our U.S. awards and accolades: Insights & Information Blog Postings about Edward Jones

Check out our Canadian awards and accolades: Insights & Information Blog Postings about Edward Jones

Position Requirements

Position Requirements:
What experience you will need:
  • Bachelor's degree in Computer Science, Information Systems or another applicable field is preferred
  • 5+ years of experience in Systems Administration
  • Minimum 3 years hands-on experience designing, deploying, managing, and supporting Azure Databricks, Azure Data Lake Storage (ADLS), and related data solutions as a Platform Engineer/Administrator, with deep knowledge of Azure cloud infrastructure, resource management, security, and networking.
  • Proficiency in automation and scripting tools including Terraform (IaC), Azure CLI, Databricks CLI, PowerShell, Python, REST API, and SQL for infrastructure provisioning, deployment, and platform management.
  • CI/CD and version control expertise with Git, GitHub Actions, and related tools to automate data and infrastructure workflows, ensuring reliable and repeatable deployment processes.
  • Preferred experience in performance tuning and optimization of Azure ADLS and Databricks clusters, cost optimization strategies, and familiarity with data ingestion tools (Qlik Replicate, Apache Kafka, Matillion ELT, Snowflake).
  • Agile development experience working collaboratively in cross-functional product teams with exposure to iterative development practices and modern collaboration frameworks.
  • Excellent communication skills with the ability to articulate complex system designs, architectural patterns, and technical solutions clearly to stakeholders across all levels of leadership, from technical teams to executives.

Candidates that live within a commutable distance from our Tempe, AZ and St. Louis, MO home office locations are expected to work in the office three days per week, with preference for Tuesday through Thursday.

Current INTERNAL home-based associates: While this role is posted as hybrid, if selected and accepted, you may retain your home-based status. Edward Jones intends in good faith to continue offering the role as home-based, though future business or regulatory needs may require on-site work.

Salary Information

Edward Jones' compensation and benefits package includes medical and prescription drug, dental, vision, voluntary benefits (such as accident, hospital indemnity, and critical illness), short- and long-term disability, basic life, and basic AD&D coverage. Short- and long-term disability, basic life, and basic AD&D coverage are provided at no cost to associates. Edward Jones offers a 401k retirement plan, and tax-advantaged accounts: health savings account, and flexible spending account. Edward Jones observes ten paid holidays and provides 15 days of vacation for new associates beginning on January 1 of each year, as well as sick time, personal days, and a paid day for volunteerism. Associates may be eligible for bonuses and profit sharing. All associates are eligible for the firm's Employee Assistance Program. For more information on the Benefits available to Edward Jones associates, please visit our benefits page.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.