Databricks Architect
Contract W2
Contract Independent
12 Months
No Travel Required
Able to Sponsor
Remote
Depends on Experience
Anagha Techno Soft
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Databricks
- Azure
- Data governance
- Delta Lake
- CI/CD
- DevOps
- Unity Catalog
- Terraform
- Azure Bicep
- Kafka
- AI/ML
Summary
Databricks Architect with Finance domain
Remote
What You'll Do:
- Own end-to-end architecture for the Databricks-on-Azure lakehouse platform, including workspace design, Unity Catalog governance, storage topology, and cluster policies
- Define and scalemedallion architecture standards (Bronze, Silver, Gold) across domains
- Establishplatform standards and reusable patterns to accelerate Databricks adoption across teams
- Design and implement secure, compliant data access frameworks (RBAC, ABAC, row/column-level security)
- Lead CI/CD and DevOps patterns for Databricks deployments, ensuring audit-ready pipelines
- Optimize performance and cost across Delta Lake pipelines (partitioning, clustering, Photon, optimization strategies)
- Build reusable ingestion frameworks for structured and streaming data (API, Kafka, CDC, batch pipelines)
- Partner with Data Governance, Security, SRE, and Legal teams to align platform design with healthcare compliance requirements
- Provide architectural guidance on PHI/PII data handling and lifecycle management
- Evaluate and recommend platform tooling (build vs. buy decisions)
- Mentor engineers and architects; establish design reviews and documentation practices
Basic Requirements:
- Bachelor's degree in Computer Science, Information Systems, or a related field, or relative experience, and typically requires 7+ years of experience in data engineering and data architecture
- Proven experience building and scaling Databricks platforms from the ground up, including workspace provisioning, Unity Catalog, and governance frameworks
- Strong hands-on expertise in Databricks and Azure (ADLS Gen2, networking, identity, security)
- Demonstrated ability to remain technically hands-on while leading architecture decisions
- Deep expertise in Delta Lake, including performance optimization and data lifecycle management
- Experience designing enterprise data platforms in regulated environments (e.g., PHI/PII handling)
- Strong understanding of data governance, access controls, and compliance frameworks
- Proven ability to establish standards, drive adoption, and influence multiple engineering teams
Preferred Skills & Experience:
- Experience scaling early-stage Databricks platforms and building enterprise-wide standards
- Familiarity with streaming and event-driven architectures (Kafka, Structured Streaming)
- Experience with Infrastructure-as-Code tools (Terraform, Azure Bicep)
- Knowledge of Databricks advanced features (Delta Live Tables, Unity Catalog federation, Delta Sharing)
- Experience supporting AI/ML data readiness and feature engineering pipelines
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91163035
- Position Id: 9072885
- Posted 3 hours ago
Company Info
About Anagha Techno Soft
Anagha Techno soft is a reputable company specializing in IT services and staff augmentation. With a commitment to delivering cutting-edge solutions and top-notch services, Anagha Techno soft caters to a diverse clientele ranging from small businesses to large enterprises.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs