Senior Databricks Architect

Washington, DC, US • Posted 9 hours ago • Updated 6 hours ago
Full Time
No Travel Required
On-site
Depends on Experience
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Amazon Web Services
  • Databricks
  • Data Architecture
  • PySpark
  • SQL
  • Apache Spark
  • Continuous Integration
  • Continuous Delivery

Summary

Role overview

Satsyil Corp is hiring a Senior Databricks Architect to define and lead the architecture of enterprise lakehouse platforms on Databricks. You will set the technical direction for data engineering, governance, analytics and AI workloads, guide engineering teams from design through production, and serve as the trusted Databricks advisor to our public-sector and commercial clients. This is a fully remote role.

Mandatory certification: Active Databricks Certified Data Engineer Professional is required at the time of application.

Proof of citizenship will be required before hire.

 

Employment type

Full-time

Work model

Onsite(4Days)-Washington D.C.

Experience

10+ years in data engineering or architecture; 5+ years on Databricks


About Satsyil Corp

Satsyil Corp is a technology services company that helps public-sector and commercial clients modernize with cloud, data engineering and AI. Our teams build secure, scalable platforms that turn data into decisions, and we invest in our people through hands-on work on high-impact programs.

Key responsibilities

  • Define the end-to-end lakehouse architecture on Databricks, including Medallion layers (Bronze, Silver, Gold), data modeling standards and reference architectures.

  • Lead design of batch and streaming pipelines using Delta Lake, Lakeflow Declarative Pipelines (Delta Live Tables), Structured Streaming and Auto Loader.

  • Architect data governance with Unity Catalog: metastore design, catalog and schema strategy, access controls, lineage, auditing and data sharing (Delta Sharing).

  • Design workspace, network and security architecture on AWS or Azure, including private connectivity, encryption, identity federation and least-privilege access.

  • Set compute strategy and cost controls: cluster policies, serverless compute, SQL warehouses, job orchestration with Databricks Workflows, and FinOps reporting from system tables.

  • Lead migrations from legacy data warehouses and Hadoop or on-premises platforms to Databricks, including assessment, roadmap and cutover planning.

  • Establish CI/CD and infrastructure-as-code standards with Databricks Asset Bundles, Terraform and Git-based workflows.

  • Architect analytics and AI capabilities: Databricks SQL and BI integration, MLflow, Feature Store, Model Serving and Mosaic AI for GenAI use cases.

  • Drive performance tuning across Spark, Photon and Delta (partitioning, liquid clustering, Z-ordering, file sizing) for large-scale workloads.

  • Ensure solutions meet federal and regulatory compliance requirements (FISMA, FedRAMP, NIST 800-53) where applicable.

  • Produce architecture artifacts: decision records, diagrams, standards and design documents; run architecture reviews.

  • Mentor data engineers and architects, lead design and code reviews, and act as the technical point of contact for client stakeholders.

  • Contribute to proposals, solution designs and technical demos for new work.

Required qualifications

  • U.S. citizenship (required).

  • Active Databricks Certified Data Engineer Professional certification (mandatory).

  • Bachelor’s degree in Computer Science, Engineering, Data Science or a related field, or equivalent experience.

  • 10+ years in data engineering, data architecture or analytics platforms, with 5+ years designing and delivering solutions on Databricks.

  • Proven architecture of at least two enterprise-scale Databricks lakehouse implementations in production.

  • Expert knowledge of Apache Spark, PySpark, Spark SQL and Delta Lake, including performance tuning at scale.

  • Hands-on production experience with Unity Catalog, Lakeflow / Delta Live Tables, Databricks Workflows and Databricks SQL.

  • Deep experience with at least one major cloud (AWS or Azure): networking, IAM, storage, encryption and security.

  • Infrastructure as code with Terraform and CI/CD for data platforms (GitHub Actions, GitLab CI, Jenkins or Azure DevOps).

  • Strong data modeling skills: dimensional, Data Vault and lakehouse patterns.

  • Clear written and spoken communication, including presenting designs and trade-offs to technical and executive audiences.

Preferred qualifications

  • Additional Databricks certifications: Machine Learning Professional or Generative AI Engineer Associate, plus the Databricks Platform Administrator accreditation.

  • Cloud architecture certifications: AWS Certified Solutions Architect – Professional or Microsoft Certified: Azure Solutions Architect Expert.

  • HashiCorp Certified: Terraform Associate.

  • Experience migrating from Teradata, Oracle, Snowflake, Cloudera/Hadoop or SQL Server to Databricks.

  • Experience with MLflow, Model Serving and GenAI architectures (RAG, Vector Search, agents) on Databricks.

  • Background in federal or regulated environments (FedRAMP, FISMA, NIST 800-53, HIPAA).

  • Ability to obtain and maintain a Public Trust or security clearance.

  • Master’s degree in a technical or quantitative field.

  • Prior consulting or client-facing delivery experience.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10491343
  • Position Id: 9147873
  • Posted 9 hours ago
Contact the job poster
UB

Uma Bhattacharya

Recruiter @ Satsyil Corporation

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.