Databricks Architect

Object Technology Solutions, Inc (OTSI) has an immediate opening for a Databricks Architect for St. Louis, MO

Major Responsibilities:

• We are seeking an experienced Databricks Architect to lead the design and implementation of an enterprise Lakehouse platform using the Medallion Architecture (Bronze/Silver/Gold).
• This role is responsible for architecting all components of the data ecosystem including ingestion frameworks, transformation pipelines, notebooks, workflows, governance, and AI/ML integration.
• The ideal candidate combines deep Databricks expertise with strong architectural leadership and hands-on engineering capability.
• Architect and implement a scalable Lakehouse platform leveraging Databricks, Delta Lake, and Medallion design principles.
• Design end to end ETL/ELT pipelines, notebooks, reusable frameworks, and orchestration using Databricks Workflows or Delta Live Tables.
• Develop data models, star schemas, and semantic layers optimized for analytics and BI consumption.
• Provide expert level Spark engineering, including performance tuning, partitioning, caching, and cluster optimization.
• Design secure, cloud-native architectures across Azure, AWS, or Google Cloud Platform, including networking, IAM, storage, and integration patterns.
• Implement Unity Catalog governance, permissions, lineage, data security, and compliance controls.
• Architect ML and AI solutions using MLflow, Feature Store, Model Serving, and modern LLM/RAG patterns.
• Optimize platform performance, reliability, and cost through monitoring, storage layout tuning, and workload management.
• Lead technical workshops, architecture reviews, and cross-functional collaboration with engineering, product, and business teams.
• Support presales activities, solution shaping, and technical guidance throughout delivery.

Qualifications and Experience Required:

• 7+ years in data engineering, data architecture, or cloud architecture roles.
• Deep hands-on experience with Databricks, Delta Lake, and Apache Spark.
• Strong proficiency in PySpark, SQL, and Python engineering best practices.
• Proven experience designing Lakehouse and modern data platform architectures.
• Strong understanding of cloud services (Azure, AWS, or Google Cloud Platform) and enterprise integration patterns.
• Expertise in Unity Catalog, data governance, security, and compliance frameworks.
• Experience with ML/AI architecture, MLflow, and production-grade model pipelines.
• Strong communication, documentation, and leadership skills.

About us:

OTSI is a global technology partner providing enterprise IT consulting, digital solutions, and managed services. We help organizations modernize complex technology landscapes, harness the power of data, and build scalable AI-led ecosystems to accelerate innovation and business growth. With over 26 years of experience, we consistently turn complex challenges into success stories through our strong technical capabilities and deep industry knowledge. Our global team of 1,800+ professionals, spread across 6 countries, delivers cutting-edge solutions for customers across Banking, Financial Services, Insurance, Transportation & Logistics, Energy & Utilities, Healthcare & Life Sciences, Government, Hi-Tech, Telecom & Media, Manufacturing, and more.

Our Center of Excellence:

• Data & Analytics
• Digital Transformation
• QA & Automation
• Enterprise Applications
• Disruptive Technologies