Databricks Architect

Job Title: Databricks Architect

Client: Bitwise

Experience: 10 to 15 years
Employment Type: Full-time

Job Summary

We are looking to hire a seasoned Databricks Architect with 10–15 years of overall experience in IT services and at least 3 years of hands-on experience in building modern data solutions using Databricks. The ideal candidate should have excellent communication skills, a proven record of architecting scalable data platforms, and the ability to lead both technical teams and client engagements.

Key Responsibilities

• Architect and Design: Build scalable and efficient data solutions using Databricks on Azure/AWS/Google Cloud Platform. Define end-to-end architecture including ingestion, transformation, data storage, data processing, data governance, and reporting & analytics.
• Customer Engagement: Work closely with customers to gather requirements, present solutions, lead architecture reviews, and align technical design with business goals.
• Team Leadership: Lead and mentor cross-functional data teams, including data engineers, analysts, and platform engineers.
• Solution Delivery: Guide the implementation of the Lakehouse,  ELT/ETL pipelines, structured/unstructured data handling, performance optimization, and automation within the Databricks environment.
• Best Practices and Governance: Promote best practices in data modeling, security, DevOps/CI-CD for Databricks, and cost-effective cloud utilization.
• Pre-sales Support: Participate in proposals, solution demos, and client workshops, especially for data modernization or cloud migration opportunities.

Required Skills

• Strong expertise in Databricks (Spark, Delta Lake, MLFlow, Workflows, Unity Catalog)
• Experience with cloud platforms: Azure, AWS, or Google Cloud Platform
• Expertise in Spark (PySpark/Scala), SQL, and data modeling concepts
• Good understanding of data ingestion tools (ADF, Kafka, REST APIs, etc.)
• Proven experience in architecting enterprise-scale data platforms
• Familiarity with DevOps practices in Databricks (CI/CD, notebooks versioning, automation scripts)
• Strong communication and presentation skills

Good to Have

• Databricks Certified Data Engineer Professional
• Exposure to data governance frameworks and tools
• Familiarity with BI tools (Power BI, Tableau) for end-to-end analytics stack
• Experience in migration projects (e.g., from legacy ETL to Databricks)

Soft Skills

• Excellent verbal and written communication
• Stakeholder management
• Strong problem-solving and analytical mindset
• Ability to thrive in a dynamic and fast-paced environment

Education

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field