Senior Databricks Engineer

Overview

Remote
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)

Skills

Databricks
Apache Spark
Python
Scala
SQL
Cloud Platforms (AWS
Azure
GCP)
Data Pipeline Architecture
Big Data Engineering
Data Governance
Distributed Systems
Containerization (Docker/Kubernetes)
CI/CD
DevOps Practices.

Job Details

Job Title: Senior Databricks Engineer
Location: Remote
Duration/Term: Long-Term Contract


Job Summary:

We are seeking an experienced Databricks Engineer with a strong background in Databricks, Apache Spark, and big data ecosystem tools. You will lead the design and development of scalable data pipelines, architect efficient data models, and mentor junior engineers ensuring performance, reliability, and governance across cloud-native infrastructure.


Key Responsibilities:

  • Design and develop data processing pipelines and analytics solutions using Databricks.
  • Architect scalable, efficient, and secure data models and storage frameworks on the Databricks platform.
  • Collaborate with architecture and engineering teams to migrate legacy solutions to Databricks.
  • Optimize Databricks clusters and job performance to meet SLAs and business needs.
  • Enforce best practices for data governance, privacy, security, and compliance.
  • Mentor junior engineers and offer technical guidance and code reviews.
  • Stay current with data engineering trends, tools, and emerging technologies to drive innovation and excellence.


Required Qualifications:

  • 9+ years of overall experience in data engineering or software development.
  • 4+ years hands-on experience with Databricks and Apache Spark
  • Proficiency in Python, Scala, or SQL for building data pipelines.
  • Solid understanding of distributed computing concepts and big data architecture.
  • Experience with at least one major cloud platform (AWS, Azure, or Google Cloud Platform) and relevant data services.
  • Proven track record of delivering scalable and reliable data solutions.
  • Strong analytical mindset, attention to detail, and problem-solving skills.
  • Excellent communication skills and ability to work across cross-functional teams.


Preferred Qualifications:

  • Experience with Docker, Kubernetes, or similar containerization/orchestration tools.
  • Familiarity with DevOps practices for automated deployment, monitoring, and CI/CD workflows.


Key Skills:

Databricks, Apache Spark, Python, Scala, SQL, Cloud Platforms (AWS, Azure, Google Cloud Platform), Data Pipeline Architecture, Big Data Engineering, Data Governance, Distributed Systems, Containerization (Docker/Kubernetes), CI/CD, DevOps Practices.


VDart Group, a global leader in technology, product, and talent management, empowers businesses with comprehensive solutions through our four distinct, industry-leading business units With a diverse team of over 4,000 professionals across 13 countries, we deliver strong results across various industries, including Fortune 500 companies

Committed to "People, Purpose, Planet," we prioritize social responsibility and sustainability, as evidenced by our EcoVadis Bronze Medal Certification and participation in the UN Global Compact

Our dedication to delivering strong results has earned us recognition as a trusted advisor for businesses seeking to drive innovation and growth, including many Fortune 500 companies Join our network! Partner with VDart Group to leverage our global network, industry expertise, and proven track record with a diverse clientele

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About VDart, Inc.