Apply Now

Databricks SME

• Posted 2 days ago • Updated 5 hours ago

Full Time

USD $175,000.00 - 195,000.00 per year

GovCIO

Fitment

Dice Job Match Score™

⭐ Evaluating experience...

Job Details

Skills

Recruiting
Usability
Scala
Data Processing
Analytics
Scalability
Caching
Data Quality
Data Warehouse
Documentation
Collaboration
Migration
Information Technology
Business Analysis
Project Management
Extract
Transform
Load
ELT
Data Modeling
Management
Provisioning
Scripting
Windows PowerShell
Bash
Conflict Resolution
Problem Solving
Effective Communication
Data Analysis
Data Visualization
Data Lake
Microsoft SQL Server
Apache Spark
PySpark
SQL
Python
Pandas
Sybase
SAP
PowerDesigner
Databricks
Microsoft Power BI
Microsoft SSRS
Microsoft SSIS
Unity
Cloud Computing
Data Engineering
Microsoft Azure
Storage
Identity Management
DevOps
Workflow
Continuous Integration
Continuous Delivery
Terraform
ARM
Onboarding
Training
Technical Support
Health Care
Data Governance
Data Security
JIRA
ServiceNow
Microsoft SharePoint
Change Management
Security Clearance

Recruiting
Usability
Scala
Data Processing
Analytics
Scalability
Caching
Data Quality
Data Warehouse
Documentation
Collaboration
Migration
Information Technology
Business Analysis
Project Management
Extract
Transform
Load
ELT
Data Modeling
Management
Provisioning
Scripting
Windows PowerShell
Bash
Conflict Resolution
Problem Solving
Effective Communication
Data Analysis
Data Visualization
Data Lake
Microsoft SQL Server
Apache Spark
PySpark
SQL
Python
Pandas
Sybase
SAP
PowerDesigner
Databricks
Microsoft Power BI
Microsoft SSRS
Microsoft SSIS
Unity
Cloud Computing
Data Engineering
Microsoft Azure
Storage
Identity Management
DevOps
Workflow
Continuous Integration
Continuous Delivery
Terraform
ARM
Onboarding
Training
Technical Support
Health Care
Data Governance
Data Security
JIRA
ServiceNow
Microsoft SharePoint
Change Management
Security Clearance

Summary

GovCIO is hiring a Databricks SME to support the Department of Veterans Affairs (VA) Data Modernization initiative. In this role, the Databricks SME will guide data scientists, analysts, infrastructure specialists and business SME to deliver production-ready data solutions. This position focuses on workspace automation, onboarding support, data platform usability, infrastructure provisioning, and white-glove customer success to ensure VA users can rapidly adopt and leverage modern data tools. This position is fully remote within the United States.

Responsibilities

Implement and manage linked services, mount points, and catalog configuration within Databricks and VA's VHA Data Lake.
Develop and optimize PySpark (Python/Scala) jobs, notebooks, and workflows in Databricks.
Build ETL/ELT pipelines using Azure Databricks Lakehouse features.
Design and implement Spark-based data processing for analytics workloads.
Optimize Databricks Spark jobs for performance, cost, and scalability (partitioning, caching, tuning, etc.).
Collaborate with data scientists, analysts, infrastructure specialists and business SME to deliver production-ready data solutions.
Experience with Delta Lake and Synapse.
Ensure data quality, governance, and security best practices.
Act as subject matter experts to the workgroups from start to finish in their migration to the cloud
Help workgroups set up their resources and migrate their work loads
Support automated data warehouse access provisioning for eligible users, ensuring seamless integration with VA Cloud Data Warehouse (CDW) systems.
Provide white-glove customer success services, including onboarding sessions, office hours, rapid async support, and creation of reusable templates, guides, and best-practice documentation.
Collaborate with Customer Success, Business Analysts, and Platform Engineering teams to refine intake processes, improve user satisfaction, and standardize workspace deployment.
Develop migration guidance and self-service resources to accelerate platform adoption and reduce user friction when transitioning from legacy data systems.
Troubleshoot user issues related to data access, workspace configuration, pipelines, cataloging, or permissions, escalating to engineering teams when needed.

Qualifications

Required Skills and Experience:

Bachelor's degree in Information Technology or a related field. (or commensurate experience)
12+ years of experience in business analysis, project management, or a similar role.
Strong experience with Databricks and Azure data services, including workspace administration, catalog creation, linked services, storage mounts, and access configuration.
Proficiency in data engineering fundamentals such as ETL/ELT pipeline development, data modeling, and managing structured and unstructured datasets.
Ability to automate provisioning workflows and infrastructure using scripting or infrastructure-as-code tools (Python, PowerShell, Bash, Terraform, ARM, or Bicep).
Strong troubleshooting and problem-solving abilities for diagnosing platform, data access, and pipeline issues and collaborating across teams for resolution.
Effective communication skills with the ability to document technical processes, create reusable templates, and support users through onboarding, office hours, and white-glove assistance.

Preferred Skills and Experience:

Experience with Data Analysis, Data Curation, Data Visualization (PowerBi), Python, Azure Synapse/Azure Data Factory, Azure Data Lake Storage, SQL Server.
Certifications: Azure Databricks and Spark for Data Engineers, PySpark and SQL, Microsoft Azure Cert, SQL, SQLlite, Python Pandas, Sybase/SAP PowerDesigner, Databricks DAB, Databricks Unity Catalog, and Databricks lakflow pipelines
Exposure to Starburst, PowerBI, SSRS, SSIS and Unity Catalog
Familiarity with modern data lakehouse architectures, distributed data systems, and cloud data engineering practices.
Strong understanding of Azure data services, including storage, compute, identity and access management, and DevOps workflows.
Experience with workflow automation, CI/CD pipelines, or infrastructure-as-code (e.g., Terraform, ARM, Bicep).
Background in user-facing or customer-success-adjacent work such as onboarding, training, communications, or technical support.
Ability to translate business needs into technical requirements and develop scalable solutions that improve platform efficiency.
Knowledge of enterprise data systems common to healthcare or federal environments, especially data governance and data-security considerations.
Experience with tools such as Jira, ServiceNow, or SharePoint for intake, change management, and support processes.

Clearance Required

Ability to obtain and maintain a suitability/Public Trust

Posted Salary Range

USD $175,000.00 - USD $195,000.00 /Yr.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10443217
Position Id: 8431
Posted 2 days ago

Company Info

About GovCIO

GovCIO is a rapidly growing provider of advanced technology solutions and digital services for the federal government. Combining our extensive federal experience with the latest innovations in IT and disruptive approaches, our experts develop comprehensive solutions to meet the most pressing demands of today’s government agencies. From the U.S. military to Health and Human Services, we have an impressive track record of helping our customers optimize how they operate.

We’re transforming government IT, empowering our federal customers to meet the challenges of today while building the government of tomorrow.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

No location provided

•

Today

GovCIO is hiring a Data Engineer to support the Department of Veterans Affairs (VA) Data Modernization initiative. In this role, the engineer will enable secure, scalable, and user-friendly data environments that accelerate analytics and improve data accessibility across the enterprise. This position focuses on workspace automation, onboarding support, data platform usability, infrastructure provisioning, and white-glove customer success to ensure VA users can rapidly adopt and leverage modern d

Full-time

USD 175,000.00 - 185,000.00 per year

Senior Data Engineer

No location provided

•

Today

GovCIO is seeking an experienced Senior Data Engineer to support the Department of Veterans Affairs (VA) Data Modernization initiative. This role focuses on enable secure, scalable, and user-friendly data environments, data platform usability, infrastructure provisioning, and white-glove customer success to ensure VA users can rapidly adopt and leverage modern data tools. This position is fully remote, located in the United States. Responsibilities Lead migration efforts from on-premises infras

Full-time

USD 195,000.00 - 225,000.00 per year

Senior Cloud Data Engineer

No location provided

•

Today

GovCIO is seeking an experienced Senior Cloud Data Engineer to support the Department of Veterans Affairs (VA) Data Modernization initiative. This role focuses on providing the necessary subject matter expertise to design, provision, and automate cloud-based data workspaces. The ideal candidate is an expert in modern cloud tools, Databricks, VHA Data Lake integrations, and automated workspace creation. This position is fully remote, located in the United States. Responsibilities Create cloud wor

Full-time

USD 195,000.00 - 225,000.00 per year

Cloud Data Engineer

No location provided

•

Today

GovCIO is seeking an experienced Cloud Data Engineer to support the Department of Veterans Affairs (VA) Data Modernization initiative. This role focuses on designing, provisioning, and automating cloud-based data workspaces that accelerate user onboarding, improve data accessibility, and strengthen platform reliability. The ideal candidate will work hands-on with modern cloud tools, Databricks, VHA Data Lake integrations, and automated workspace creation .This position is fully remote, located i

Full-time

USD 175,000.00 - 200,000.00 per year

Search all similar jobs