15+ Senior Databricks Professionals | Remote

Job Overview

Mandatory Requirements

·                10+ years of overall IT experience

·                Mandatory: Active Professional Certification in Databricks (Databricks Certified Professional level)

·                Experience supporting Federal / Government clients preferred

·                Strong background in enterprise-scale data engineering and cloud platforms

·                Ability to work effectively in a remote and distributed environment

Key Responsibilities

·                Design, build, and optimize enterprise-grade Databricks Lakehouse solutions

·                Develop scalable data pipelines, ETL/ELT frameworks, and data transformation workflows

·                Implement data ingestion and processing using Apache Spark and Databricks

·                Architect cloud-native analytics platforms and data modernization initiatives

·                Collaborate with business, engineering, and architecture teams to define data strategies

·                Optimize performance, cost efficiency, and reliability of data platforms

·                Establish best practices for governance, security, monitoring, and CI/CD

·                Support data migration and modernization programs

·                Ensure compliance with enterprise and federal security requirements

·                Mentor technical teams and provide architectural guidance

Required Technical Skills

·                Expert-level experience with Databricks Platform

·                Strong hands-on expertise in Apache Spark (PySpark / Spark SQL)

·                Experience with Delta Lake, Unity Catalog, and Databricks Workflows

·                Proficiency in Python, SQL, Scala (preferred)

·                Cloud experience in AWS / Azure / Google Cloud Platform

·                Data warehousing and lakehouse architecture experience

·                Experience with ETL/ELT, orchestration, and workflow automation

·                Knowledge of Data Governance, Security, and Compliance

·                Experience with Git, CI/CD, DevOps practices

·                Familiarity with streaming and batch processing architectures

Preferred Qualifications

·                Prior experience supporting Federal agencies or public sector programs

·                Exposure to AI/ML workloads on Databricks

·                Experience with infrastructure automation and cloud-native services

·                Strong communication and stakeholder management skills