Job Description:
We are looking for a Databricks Platform Expert with extensive experience in end-to-end Databricks implementations who can act as a Solution Architect. This role will lead the design, architecture, and deployment of Databricks-based solutions, ensuring best practices for scalability, security, and performance.
Key Responsibilities
Solution Architecture & Design
· Define and implement Databricks architecture for enterprise-scale data platforms.
Design data lakehouse solutions leveraging Databricks capabilities.
· Establish best practices for cluster management, job orchestration, and cost optimization.
Implementation & Integration
· Lead end-to-end Databricks platform setup, including workspace configuration, security, and governance.
· Integrate Databricks with cloud services (Azure/AWS/Google Cloud Platform) and enterprise data sources.
· Develop data pipelines, ETL/ELT workflows, and optimize performance for large-scale workloads.
Collaboration & Leadership
· Act as a technical advisor to stakeholders and guide teams on Databricks adoption.
· Provide solution blueprints, architecture diagrams, and documentation.
Ensure compliance with data governance, security, and regulatory standards.
Required Qualifications:
· 10+ years of experience in data engineering, analytics, or platform architecture.
Extensive hands-on experience with Databricks, including:
# Workspace setup and administration.
# Cluster configuration and optimization.
# Job scheduling and orchestration.
· Proven track record of end-to-end Databricks implementations in enterprise environments.
· Strong understanding of data lakehouse architecture, Medallion architecture, and cloud-native data platforms.
· Expertise in Spark, SQL, and Python for data processing.
Preferred Skills
· Experience with Azure Databricks, AWS Glue, or Google BigQuery.
Knowledge of CI/CD pipelines, DevOps practices, and Infrastructure as Code.
· Familiarity with data security frameworks and cost optimization strategies.
Never miss an opportunity! Create an alert based on the job you applied for.
