Information Architect (Databricks Platform / Solution Architect)

Job Title: Information Architect (Databricks Platform / Solution Architect)

Location: Remote

Role Summary
We are seeking a Databricks Platform Expert to serve as a Solution Architect, leading the design, architecture, and deployment of enterprise-scale Databricks solutions. This role will drive end-to-end Databricks implementations while ensuring best practices for scalability, security, governance, and performance across cloud-based data platforms.

Key Responsibilities

Solution Architecture & Design

• Design and implement enterprise-grade Databricks architectures.

• Build scalable data lakehouse solutions using Databricks and Medallion architecture.

• Define best practices for cluster management, job orchestration, performance tuning, and cost optimization.

Implementation & Integration

• Lead end-to-end Databricks platform setup, including workspace configuration, security, and governance.

• Integrate Databricks with cloud platforms (Azure, AWS, or Google Cloud Platform) and enterprise data sources.

• Develop and optimize data pipelines and ETL/ELT workflows for large-scale data processing.

Collaboration & Technical Leadership

• Act as a trusted technical advisor to stakeholders and engineering teams.

• Provide architecture blueprints, solution designs, and technical documentation.

• Ensure compliance with data governance, security, and regulatory standards.

Required Qualifications

• 10+ years of experience in data engineering, analytics, or platform architecture.

• Extensive hands-on experience with Databricks, including:

  • Workspace setup and administration

  • Cluster configuration and optimization

  • Job scheduling and orchestration

• Proven experience delivering end-to-end Databricks implementations in enterprise environments.

• Strong knowledge of data lakehouse concepts, Medallion architecture, and cloud-native data platforms.

• Expert-level skills in Spark, SQL, and Python.

Preferred Skills

• Experience with Azure Databricks, AWS Glue, or Google BigQuery.

• Knowledge of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).

• Familiarity with data security frameworks and cloud cost optimization strategies.

Education

• Bachelor’s degree in Computer Science or a related field (or equivalent experience).