Senior Azure Databricks

St. Louis, MO, US • Posted 6 days ago • Updated 6 days ago

Contract Independent

Contract W2

On-site

Depends on Experience

MASH Pro Tech

Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

Databricks
Apache Spark
Delta Lake
Azure

Summary

We are seeking a skilled Databricks Specialist to design, develop, and optimize big data solutions on the Databricks platform. The ideal candidate will have strong experience in Apache Spark, data engineering, and cloud platforms to build scalable data pipelines and analytics solutions.

Key Responsibilities

Design and implement scalable data pipelines using Databricks and Apache Spark
Develop and optimize ETL/ELT workflows for structured and unstructured data
Work with large datasets in data lakes and data warehouses
Integrate data from multiple sources (APIs, databases, streaming platforms)
Optimize performance of Spark jobs and Databricks clusters
Implement Delta Lake architecture and manage data versioning
Collaborate with data scientists, analysts, and business teams
Ensure data quality, governance, and security best practices
Troubleshoot and resolve data processing issues
Document solutions and maintain technical specifications

Required Skills

Strong hands-on experience with Databricks
Proficiency in Apache Spark (PySpark/Scala/Spark SQL)
Experience with Delta Lake
Solid knowledge of data engineering concepts and ETL processes
Experience with cloud platforms: Azure (preferred), AWS, or Google Cloud Platform
Knowledge of SQL and relational databases
Understanding of data warehousing concepts
Experience with Git and CI/CD practices

Preferred Skills (Nice to Have)

Experience with Azure Data Factory / AWS Glue
Knowledge of streaming technologies (Kafka, Structured Streaming)
Familiarity with Power BI / Tableau or other BI tools
Experience with ML workloads on Databricks
Understanding of DevOps and automation

Education

Bachelor s degree in Computer Science, Engineering, or related field (or equivalent experience)

Soft Skills

Strong analytical and problem-solving skills
Good communication and collaboration skills
Ability to work in a fast-paced environment

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91166674
Position Id: 8875990
Posted 6 days ago

Company Info

About MASH Pro Tech

Welcome to MASH Pro Tech, where innovation meets excellence. We are a leading technology solutions provider dedicated to transforming businesses through cutting-edge technology and unparalleled expertise. Our mission is to empower organizations with the tools and knowledge they need to thrive in the digital age.

Choosing MASH Pro Tech means partnering with a team that is passionate about technology and dedicated to your success. We take the time to understand your business and develop solutions that drive real results. With our extensive experience and commitment to excellence, you can trust us to deliver the best possible outcomes for your organization.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.