Databricks Architect
NeoTech Solutions
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Extract
- Transform
- Load
- Regulatory Compliance
- Machine Learning Operations (ML Ops)
- Data Governance
- Databricks
- Data Engineering
- Microsoft Azure
- PySpark
- SQL
- Cloud Architecture
- Cloud Computing
- Data Flow
Summary
Job Title: Databricks Architect
Location: Los Angeles, CA or New York, NY (Onsite)
Overview
We are seeking an experienced Databricks Architect to design and implement scalable data solutions on the Databricks Lakehouse Platform. The ideal candidate will have strong expertise in Databricks, Spark, Delta Lake, cloud platforms (Azure/AWS/Google Cloud Platform), and modern data engineering practices. This role involves architecting enterprise data platforms, optimizing performance, and enabling analytics and AI/ML workloads.
Key Responsibilities
- Design end-to-end Databricks Lakehouse architectures.
- Build scalable ETL/ELT pipelines using PySpark, Spark SQL, and Databricks Workflows.
- Implement Delta Lake (Bronze/Silver/Gold), Structured Streaming, and Auto Loader.
- Optimize Spark jobs, clusters, and platform performance.
- Integrate Databricks with Azure, AWS, or Google Cloud Platform services.
- Implement CI/CD using Git, Databricks Repos, and Terraform.
- Ensure data governance, security, and compliance using Unity Catalog.
- Collaborate with Data Engineers, Data Scientists, and business stakeholders while providing architectural guidance.
Required Skills
- 7+ years of Data Engineering/Architecture experience.
- 3+ years of hands-on Databricks experience.
- Strong expertise in Databricks, Spark, PySpark, SQL, and Delta Lake.
- Experience with Azure (ADF, ADLS, Azure DevOps), AWS (S3, Glue, Lambda), or Google Cloud Platform (GCS, Dataflow, Pub/Sub).
- Experience with CI/CD, Git, Terraform, and Databricks Workflows.
- Strong understanding of data governance, performance tuning, and cloud architecture.
Preferred
- Databricks Certifications.
- Experience with MLflow, Feature Store, or MLOps.
- Experience in BFSI, Healthcare, or other regulated industries.
- Dice Id: 10118842
- Position Id: 9025613
- Posted 2 days ago
Company Info
Established in 1996, Neotech Solutions has devoted itself to encouraging and ensuring the growth of our clients across the globe for over two decades now. Operating in India, USA, Canada, and Vietnam, we have been able to secure successful partnerships with the leading names in the areas of automotive, aerospace, manufacturing, healthcare, VLSI, logistics, and BFSI.
Since inception, Neotech has seamlessly delivered over 10 million hours of technical and engineering solutions to our clients. In this fast-growing economy, we have been able to effortlessly keep up with the revolutionary changes and maintain steady, long-term partnerships with our clients, which is a testament to our commitment to the industry as well as the top tier service we provide.
Neotech has also made remarkable contributions to the areas of Automotive, Aerospace, IT & Digital, and Government Services and continues to excel in these domains.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs