Databricks SME (AI/ML & Risk analytics)

Senior Databricks SME — AI/ML Security & Risk Analytics
Cybersecurity & Risk Programs

Overview

We are sourcing a Senior Databricks Subject Matter Expert to support a federal cybersecurity program focused on building and improving automated workflows across ISSO operations, risk management, and threat-based security functions. This is a hands-on engineering role — you will design and implement Databricks-based solutions that apply AI and ML to security data at enterprise scale. The right candidate builds, not advises.

What You Will Do

• Design, build, and optimize Databricks workflows supporting ISSO compliance operations, risk management processes, and threat detection functions
• Apply AI and ML models within Databricks to automate security analytics — including anomaly detection, risk scoring, threat classification, and identity-based fraud detection
• Extract, transform, and analyze large-scale security datasets to produce actionable intelligence and executive-ready reporting
• Collaborate with ISSOs, Risk Analysts, and Threat teams to understand operational pain points and translate them into automated, data-driven solutions
• Build and maintain data pipelines that ingest security telemetry from identity platforms, SIEM tools, vulnerability scanners, and compliance systems
• Develop and refine ML models for continuous improvement of detection accuracy, risk prioritization, and compliance monitoring
• Produce metrics, dashboards, and reports that tell a clear story to both technical teams and senior leadership
• Support data quality initiatives — identifying and remediating data integrity issues within security and identity datasets

What You Need

• 3+ years of hands-on Databricks experience — building workflows, pipelines, and analytics solutions in production environments
• Demonstrated AI/ML engineering experience applied to security, risk, or identity use cases — not research, shipped solutions
• Strong Python proficiency — PySpark, Pandas, and ML libraries (scikit-learn, MLflow, or equivalent)
• Experience integrating Databricks with security data sources — SIEM platforms, identity tools (Okta, Ping, SailPoint), vulnerability management systems
• Familiarity with ISSO operations, RMF, NIST 800-53, or federal compliance frameworks — enough to understand the problem space
• Ability to communicate complex analytical findings to non-technical stakeholders including senior leadership and compliance officers