Sr. Databricks Solutions Consultant/Architect

Job Description

- Secret Clearance is required - can hold Top Secret if the candidate has it - not SCI
- Location: Huntsville, Alabama (relocation assistance is available)
- End Client: FBI
- 2x onsite per week through 9/30/2026, after 9/30 it moves up to 5x week. Until 9/30, the selected candidate will provide will provide 2 days to this program, the other 3 days will be internal support. After 9/30, they will support the end-client 5 days per week.
- Interview Process: 3 video interviews. First with our client, then w/ Databricks
- Sr. Databricks Solutions Architect - Consultant level, no JR candidates. Seeking candidates that can go to the client site and tell them the right way to do a Databricks solutions.
- Lead level for this Client/Project, seeking lead/sr level candidates only. JR/MID level will not get it done.-
- Expert in Performance Optimization
- Must have supported 6-8 Databricks projects / 10 years Data Engineer Consulting exp
- Must have basic Cloud Exp Knowledge - Either of the 3 will work - Azure, Google Cloud Platform, AWS, is acceptable-

Sr. Databricks Solutions Consultant/Architect to join our clients team in Huntsville, Alabama (relocation assistance is available). This is a full-time, direct opportunity with our client.

Until 9/30/2026, the selected candidate will be required to be onsite in Huntsville AL twice (2x) per week. After 9/30/2026, the selected candidate will be required to be onsite five (5x) per week.

As a member of the team, you will work with customers on short- to medium-term engagements, providing technical guidance, architecture, and hands-on support to ensure they maximize value from their Databricks environments. You will collaborate with clients to design, implement, and optimize data pipelines, analytics workflows, and machine learning solutions, all while delivering exceptional customer service and consulting expertise. Responsibilities Include:

- Lead customer engagements to design, build, and optimize Databricks-based architectures for advanced analytics, data engineering, and machine learning workloads.
- Develop scalable ETL/ELT pipelines and integrate with cloud platforms (AWS, Azure, or Google Cloud Platform).
- Guide customers on data governance, security, and compliance best practices within Databricks environments.
- Consult on architecture, reference implementations, and best practices for leveraging Delta Lake, Unity Catalog, MLflow, and related Databricks capabilities.
- Assist customers with productionalizing data pipelines, machine learning workflows, and AI-driven applications.
- Provide escalated technical support for customer operational issues and help troubleshoot complex platform or workflow challenges.
- Collaborate with internal and Databricks teams, including Engineers, Architects, Project Managers, and Customer Success teams, to ensure engagement goals are met.
- Document technical designs, architecture patterns, deployment procedures, and lessons learned.
- Stay current on Databricks platform features, distributed computing trends, and emerging big data technologies.
- Deliver solutions that improve performance, scalability, and operational efficiency while meeting customer business objectives.
- Support Professional Services and Managed Services initiatives as needed, ensuring billable deliverables meet customer expectations.

Required Skills
- US Secret Clearance required. (Secret)
- 7+ years of experience in Data Engineering.
- 10+ years of consulting experience, preferably in data platform or analytics-focused engagements.
- Completion of 6-8 hands-on projects with Databricks in production environments.
- Proven experience with Databricks, including Spark, Delta Lake, MLflow, and cloud integration. Expert in Performance Optimization
- Must have Cloud Experience in any of the big three platforms (Google Cloud Platform, Azure, AWS)
- Strong proficiency in Python and/or SQL for data engineering and analytics.
- Deep understanding of distributed computing concepts and Apache Spark runtime internals.
- Hands-on experience designing and deploying end-to-end big data and machine learning solutions.
- Familiarity with data modeling, performance tuning, and production-grade pipeline design.
- Experience working directly with customers in a consulting or professional services capacity.
- Ability to manage technical scope, timelines, and delivery while maintaining excellent customer communication.

Desired Skills
- Master-s or PhD in Computer Science, Data Science, or related field.
- Experience implementing MLOps pipelines and productionizing machine learning workflows.
- Knowledge of CI/CD, version control (Git), and infrastructure-as-code tools (Terraform, ARM, CloudFormation).
- Exposure to streaming data technologies (Kafka, Kinesis, Event Hubs).
- Familiarity with data visualization tools (Tableau, Power BI, Looker).
- Experience with regulatory compliance frameworks (HIPAA, FedRAMP, SOC2).