Protos IT
Protos IT

Databricks Data Engineer-- Bethesda, MD/ Hybrid(prefer someone who can be onsite as needed)

Hybrid in Bethesda, MD, US • Posted 6 hours ago • Updated 6 hours ago
Contract Independent
Contract W2
6 Months
Hybrid
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Databricks
  • Dimensional Modeling
  • Database
  • Data Warehouse
  • Data Engineering
  • Data Governance
  • Data Lake
  • Conflict Resolution
  • Continuous Delivery
  • Continuous Integration
  • Data Architecture
  • Apache Kafka
  • Apache Spark
  • Cloud Computing
  • Cloud Storage
  • Collaboration
  • Data Processing
  • Data Quality
  • ELT
  • Extract
  • Transform
  • Load
  • Git
  • Management
  • Microsoft
  • Microsoft Azure
  • Orchestration
  • Performance Tuning
  • Problem Solving
  • PySpark
  • Python
  • SQL
  • Scalability
  • Software Engineering
  • Streaming
  • Technical Drafting
  • Terraform
  • Unity
  • Workflow
  • Access Control

Summary

Job Title: Databricks Data Engineer

Location: Bethesda, MD/ Hybrid (2 days onsite / 3 days Remote)

Duration: 6+ Months Contract to full-time Hire

But prefer someone who can be onsite as needed.

Role Overview::

We are seeking a skilled Databricks Data Engineer to design, build, and maintain scalable data pipelines and data platforms using Databricks, Apache Spark, Delta Lake, and cloud technologies. The ideal candidate will have strong experience in data engineering, ETL/ELT development, large-scale data processing, and modern Lakehouse architectures.

Key Responsibilities::

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks.
  • Develop data processing solutions using Apache Spark, PySpark, and SQL.
  • Build and manage Delta Lake tables and implement Medallion Architecture (Bronze, Silver, and Gold layers).
  • Ingest data from structured and unstructured sources, including databases, APIs, files, streaming platforms, and cloud storage.
  • Optimize Spark workloads, Databricks clusters, SQL queries, and data pipelines for performance and cost efficiency.
  • Implement data quality checks, validation rules, monitoring, logging, and error-handling frameworks.
  • Develop reusable data engineering frameworks and utilities.
  • Work with Databricks Workflows/Jobs to schedule and orchestrate pipelines.
  • Implement data governance, security, access controls, and data lineage using Unity Catalog.
  • Collaborate with data architects, analysts, data scientists, application teams, and business stakeholders.
  • Support CI/CD processes for Databricks notebooks, code, and data pipelines.
  • Troubleshoot production data issues and ensure reliability, scalability, and availability of data solutions.
  • Participate in code reviews, technical design discussions, and data architecture decisions.
  • Document data pipelines, transformation logic, architecture, and operational procedures.

Required Skills::

  • Strong hands-on experience with Databricks.
  • Strong knowledge of Apache Spark and PySpark.
  • Advanced SQL and data transformation skills.
  • Experience with Delta Lake and Lakehouse architecture.
  • Experience designing and implementing ETL/ELT pipelines.
  • Strong understanding of data warehousing, dimensional modeling, and data lake concepts.
  • Experience working with Microsoft Azure
  • Experience with cloud storage technology - ADLS
  • Knowledge of Databricks Jobs, Workflows, notebooks, clusters, and compute configurations.
  • Experience with Unity Catalog, data governance, and role-based access control.
  • Familiarity with Git and CI/CD practices.
  • Strong troubleshooting, performance optimization, and problem-solving skills.

Preferred Skills::

  • Experience with Databricks Auto Loader and Structured Streaming.
  • Experience with Delta Live Tables / Lakeflow Declarative Pipelines.
  • Knowledge of Kafka or other streaming technologies.
  • Experience with orchestration tools such as Azure Data Factory, Airflow, or equivalent.
  • Experience with Terraform or other Infrastructure-as-Code technologies.
  • Knowledge of Python software engineering best practices.
  • Experience implementing data quality frameworks.
  • Familiarity with Databricks Asset Bundles and automated deployment practices.
  • Databricks certification is a plus.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: RTX1614ae
  • Position Id: 9128803
  • Posted 6 hours ago
Contact the job poster
SA

Srini Addala

Recruiter @ Protos IT

View Profile
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at Protos IT in Bethesda, MD