Senior Databricks Engineer

McLean, VA, US • Posted 2 hours ago • Updated 2 hours ago
Full Time
Travel Required
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

✨ Finding the perfect fit...

Job Details

Skills

  • Azure
  • DataBricks
  • AI
  • Data Engineering
  • AI Tools
  • Copilot
  • Claude
  • ELT
  • Data Security
  • Data Modeling
  • Data Processing
  • Communication
  • Python

Summary

Job Title: Databricks Engineer

Employment Type: Full Time

Location: Vienna, VA (Onsite)

Job Description

We are seeking an experienced Senior Databricks Engineer to design, develop, and optimize enterprise-scale data platforms on Databricks. The ideal candidate will have strong expertise in building scalable data pipelines, cloud data engineering, and modern Lakehouse architectures. This role requires working closely with data architects, analytics teams, and business stakeholders to deliver high-performance data solutions.

Required Skills

  • 7+ years of experience in Data Engineering.
  • 3+ years of hands-on experience with Databricks.
  • Strong experience with Apache Spark (PySpark/Scala/Spark SQL).
  • Experience building ETL/ELT pipelines using Databricks.
  • Strong knowledge of Delta Lake, Unity Catalog, and Lakehouse architecture.
  • Experience with Azure Databricks (preferred) or AWS Databricks.
  • Strong SQL programming skills.
  • Experience with Python and/or Scala.
  • Experience with cloud storage technologies (ADLS, S3, Azure Blob).
  • Knowledge of CI/CD, Git, Azure DevOps, or Jenkins.
  • Experience with workflow orchestration tools such as Airflow or Databricks Workflows.
  • Understanding of data modeling, performance tuning, and optimization.
  • Experience with streaming technologies is a plus (Kafka, Structured Streaming).
  • Strong communication and stakeholder management skills.

Preferred Qualifications

  • Azure Data Engineer or Databricks certifications.
  • Experience with Snowflake, Azure Synapse, or Microsoft Fabric.
  • Experience implementing data governance and security best practices.
  • Financial Services or Federal domain experience is a plus.

Responsibilities

  • Design and develop scalable data pipelines using Databricks.
  • Build and optimize Spark applications for large-scale data processing.
  • Develop ETL/ELT workflows using PySpark and SQL.
  • Implement Delta Lake best practices for data quality and performance.
  • Collaborate with architects and business teams to define data solutions.
  • Optimize Databricks clusters, jobs, and notebooks.
  • Implement CI/CD pipelines and DevOps best practices.
  • Monitor production workloads and troubleshoot performance issues.
  • Ensure data security, governance, and compliance standards are met.
  • Document technical solutions and mentor junior engineers.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10367586
  • Position Id: 9042069
  • Posted 2 hours ago

Company Info

About eSolutionsFirst, LLC

eSolutionsFirst is a premier technology and talent solutions partner providing best-in-class IT solutions and staffing services that empower our clients to be market leaders.

We Believe in Consistent, Quality & Transparent Hiring Process.

As a pioneer in talent management since we are proud of bridging the gap between diverse aspiring talent and various visionary organizations. Our people-centric Workforce portfolio spans across to help businesses overcome any talent management challenge. Our experience in serving industry leaders and Fortune500 companies gear us to empower enterprises of any size and industry with our dynamic staffing solutions.

 We Deliver the Promise of Modern Technology.

Our leading-edge capabilities in Cloud, Data, and Security have been fortifying businesses with accelerated digital transformation over years. Our proven methodologies and pragmatic approaches revolutionize IT environments across diverse industries. Through our advisory and end-to-end digital transformation solutions, we encourage companies to establish a “Cloud-First Data-Driven” culture.

 • Over 1,000 man-years of services in IT services.

• Over 100+ software development and management engagements.

• Over 17+ years of advisory services and multiple commercial-grade software products developed.

About_Company_OneAbout_Company_Two
Contact the job poster
AS

Ansh Srivastava

Recruiter @ eSolutionsFirst, LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

McLean, Virginia

17d ago

Easy Apply

Full-time

Depends on Experience

Vienna, Virginia

Today

Easy Apply

Contract

Depends on Experience

Search all similar jobs