Databricks Architect

We are looking for a Databricks Platform Expert with extensive experience in end-to-end Databricks implementations who can act as a Solution Architect. This role will lead the design, architecture, and deployment of Databricks-based solutions, ensuring best practices for scalability, security, and performance.

Define and implement Databricks architecture for enterprise-scale data platforms.

Design data lakehouse solutions leveraging Databricks capabilities.

Establish best practices for cluster management, job orchestration, and cost optimization.

Lead end-to-end Databricks platform setup, including workspace configuration, security, and governance.

Integrate Databricks with cloud services (Azure/AWS/Google Cloud Platform) and enterprise data sources.

Develop data pipelines, ETL/ELT workflows, and optimize performance for large-scale workloads.

Act as a technical advisor to stakeholders and guide teams on Databricks adoption.

Provide solution blueprints, architecture diagrams, and documentation.

Ensure compliance with data governance, security, and regulatory standards.

10+ years of experience in data engineering, analytics, or platform architecture.

Extensive hands-on experience with Databricks, including:

Workspace setup and administration.

Cluster configuration and optimization.

Job scheduling and orchestration.

Proven track record of end-to-end Databricks implementations in enterprise environments.

Strong understanding of data lakehouse architecture, Medallion architecture, and cloud-native data platforms.

Expertise in Spark, SQL, and Python for data processing.

Experience with Azure Databricks, AWS Glue, or Google BigQuery.

Knowledge of CI/CD pipelines, DevOps practices, and Infrastructure as Code.

Familiarity with data security frameworks and cost optimization strategies.

Keywords:

Education: BS in computer or related field.