Databricks Solution architect
Full Time
No Travel Required
Remote
$80/hr
NexTurn, Inc.
Fitment
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Databricks Lakehouse Platform
- Apache Spark
- PySpark
- Delta Lake
- Un
- ity Catalog
- Databricks SQL
- Databricks Workflows
- Jobs
- Delta Live Tables
- Lakeflow
- Data governance
- security
Summary
Job Title: Databricks Architect
Location: Irving TX ( Hybrid 3 days onsite 2 days Remote)
Rate: $85/hr on C2C
Location: Irving TX ( Hybrid 3 days onsite 2 days Remote)
Rate: $85/hr on C2C
Visa: Any
Experience Level: 12+Years of experience
Client: Mckesson
Job Summary
We are looking for an experienced Databricks Solution Architect to design, architect, and lead the implementation of enterprise-scale data and AI solutions using the Databricks Data Intelligence Platform. The ideal candidate should have strong hands-on experience with Databricks, Lakehouse architecture, Apache Spark, Delta Lake, Unity Catalog, cloud platforms, data engineering, and modern data/AI architectures.
The candidate will work closely with business stakeholders, data engineers, developers, cloud teams, and enterprise architects to translate business requirements into scalable, secure, high-performance Databricks solutions.
Databricks' architecture guidance emphasizes Lakehouse architecture, governance, security, reliability, performance, cost optimization, and interoperability.
Key Responsibilities
- Design and implement enterprise-grade Databricks Lakehouse architectures across development, testing, and production environments.
- Define target-state architecture for data engineering, analytics, BI, machine learning, and AI workloads.
- Architect solutions using Databricks, Delta Lake, Apache Spark, Unity Catalog, Databricks SQL, Workflows, and Lakehouse Federation.
- Design and implement enterprise data governance, security, access control, lineage, and data-sharing strategies using Unity Catalog.
- Lead migration of legacy data platforms, data warehouses, and Hive Metastore environments to Databricks/Unity Catalog.
- Develop scalable data ingestion and processing architectures for batch and streaming workloads.
- Provide technical leadership for performance tuning, scalability, reliability, and cost optimization of Databricks environments.
- Design cloud-native solutions leveraging AWS, Azure, or Google Cloud Platform and integrate Databricks with cloud storage, networking, security, and identity services.
- Establish Infrastructure as Code (IaC) and deployment strategies using Terraform and CI/CD. Databricks currently recommends Terraform for automating workspace, networking, storage, and Unity Catalog infrastructure.
- Collaborate with DevOps teams to implement automated deployment pipelines and environment promotion.
- Provide technical guidance to data engineers and development teams and conduct architecture/design reviews.
- Work directly with customers and stakeholders to understand requirements and present architecture options and recommendations.
- Create architecture diagrams, technical design documents, standards, and implementation roadmaps.
- Troubleshoot complex production issues and provide architectural recommendations for resolution.
- Stay current with emerging Databricks Data + AI capabilities, Generative AI, ML, and Lakehouse technologies.
Required Skills
- 12+ years of experience in Data Engineering, Data Architecture, Cloud Architecture, or related fields.
- 5+ years of strong Databricks experience, including architecture and implementation.
- Strong hands-on experience with:
- Databricks Lakehouse Platform
- Apache Spark / PySpark
- Delta Lake
- Unity Catalog
- Databricks SQL
- Databricks Workflows / Jobs
- Delta Live Tables / Lakeflow
- Data governance and security
- Strong understanding of Data Lake, Data Warehouse, and Lakehouse architectures.
- Experience designing enterprise-scale batch and real-time/streaming data pipelines.
- Strong programming experience with Python and/or Scala.
- Strong SQL development and performance-tuning skills.
Experience with at least one major cloud platform:
- AWS
- Microsoft Azure
- Google Cloud Platform
- Experience with cloud storage technologies such as Amazon S3, Azure Data Lake Storage, or Google Cloud Storage.
- Experience with Terraform/IaC and CI/CD.
- Strong understanding of networking, IAM, authentication, encryption, and cloud security.
- Excellent communication, presentation, documentation, and stakeholder-management skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
- Dice Id: 91163922
- Position Id: 9085890
- Posted 9 hours ago
Company Info
About NexTurn, Inc.
NexTurn is a next-generation engineering services firm specialized in providing cloud native solutions. We help clients accelerate their innovation & digital transformation journey by unlocking full value of cloud. We are a team of passionate technologists with strong experience in architecting, developing, deploying, and operating large scale modern applications & infrastructure in a hybrid multi-cloud environment.
Our consultants/architects are high performing engineering talent with integrated full stack competencies, have strong technology transformation experience and operate with a product-centric mindset. NexTurn enables clients navigate the paradigm shift in digital engineering with Cloud-First solutions. Our services are aligned with Client’s digital transformation journey covering setting up strong cloud foundation & Security practices, Cloud Native Engineering and Data Engineering. Also, our platforms driven approach across the engineering lifecycle accelerates experimentation, creates new value, and drives intelligent automation.
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs