Senior Data Engineer (Databricks)

Vienna, VA, US • Posted 1 hour ago • Updated 1 hour ago
Full Time
No Travel Required
On-site
Depends on Experience
Company Branding Image
Fitment

Dice Job Match Score™

📋 Comparing job requirements...

Job Details

Skills

  • Senior Data Engineer (Databricks)

Summary

Senior Data Engineer (Databricks)  

12 Months contract – Extension   / Fulltime Job

Location:   Vienna, VA 22182

Interview : ASAP

Job description:

Job Summary

  • We are seeking a highly skilled Senior Data Engineer with 10+ years of experience in designing and building scalable data platforms using Databricks, Apache Spark, and cloud technologies.
  • The ideal candidate will have strong expertise in data engineering, ETL development, distributed data processing, and modern data architectures, along with exposure to Machine Learning and Generative AI solutions.

Required Skills

  • 10+ years of experience in Data Engineering and Big Data technologies
  • Hands-on experience with Databricks
  • Strong expertise in Apache Spark (PySpark/Spark SQL)
  • Strong programming experience in Python and SQL
  • Experience with Scala (preferred)
  • Experience designing and implementing enterprise-scale data architectures
  • Expertise in building scalable ETL/ELT data pipelines
  • Experience with Delta Lake, Unity Catalog, and Databricks Workflows
  • Experience with cloud platforms (AWS, Azure, or Google Cloud Platform)
  • Knowledge of data warehousing concepts and dimensional modeling
  • Experience with CI/CD, Git, and Agile methodologies
  • Strong analytical, problem-solving, and communication skills
  • Preferred Skills
  • Experience with Machine Learning pipelines
  • Exposure to Generative AI and Databricks Mosaic AI
  • Experience with MLflow
  • Experience modernizing legacy data platforms
  • Client-facing consulting experience

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
  • Build ETL/ELT solutions to ingest, transform, and process large-scale structured and unstructured data.
  • Develop high-performance data solutions using Python, SQL, and Spark.
  • Implement Delta Lake architecture for reliable and scalable data processing.
  • Optimize Spark jobs for performance, scalability, and cost efficiency.
  • Collaborate with data architects, data scientists, and business stakeholders to deliver data-driven solutions.
  • Design and maintain enterprise data models and cloud-based data architectures.
  • Support data migration and modernization initiatives to the Databricks platform.
  • Implement data quality, governance, security, and monitoring best practices.
  • Develop reusable frameworks and automation for data engineering workflows.
  • Integrate Machine Learning and AI capabilities into enterprise data platforms.
  • Troubleshoot production issues and optimize existing data pipelines.
  • Participate in architecture discussions and recommend best practices for scalable data solutions.
  • Work within Agile teams and contribute to sprint planning, code reviews, and continuous improvement.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10367586
  • Position Id: 9037637
  • Posted 1 hour ago

Company Info

About eSolutionsFirst, LLC

eSolutionsFirst is a premier technology and talent solutions partner providing best-in-class IT solutions and staffing services that empower our clients to be market leaders.

We Believe in Consistent, Quality & Transparent Hiring Process.

As a pioneer in talent management since we are proud of bridging the gap between diverse aspiring talent and various visionary organizations. Our people-centric Workforce portfolio spans across to help businesses overcome any talent management challenge. Our experience in serving industry leaders and Fortune500 companies gear us to empower enterprises of any size and industry with our dynamic staffing solutions.

 We Deliver the Promise of Modern Technology.

Our leading-edge capabilities in Cloud, Data, and Security have been fortifying businesses with accelerated digital transformation over years. Our proven methodologies and pragmatic approaches revolutionize IT environments across diverse industries. Through our advisory and end-to-end digital transformation solutions, we encourage companies to establish a “Cloud-First Data-Driven” culture.

 • Over 1,000 man-years of services in IT services.

• Over 100+ software development and management engagements.

• Over 17+ years of advisory services and multiple commercial-grade software products developed.

About_Company_OneAbout_Company_Two
Contact the job poster
GR

Gajendra Ravuru

Recruiter @ eSolutionsFirst, LLC
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

McLean, Virginia

14d ago

Easy Apply

Full-time

Depends on Experience

McLean, Virginia

6d ago

Easy Apply

Full-time

$90 - $100

Search all similar jobs