Position: Senior Databricks Developer / Architect – AI & Data Modernization
Location: 1 day onsite per week in San Francisco, CA (near BART) - Fully Remote for Non-Local Candidates
Engagement: Contract - 2 Years
Industry: Fashion Retail
Focus: Databricks | AI/ML | Data Engineering | EDW Modernization
We are looking for a Senior Databricks Developer/Architect to support a large-scale EDW modernization and AI initiative. The role involves migrating a 20-year-old SQL-based data warehouse to Databricks through full re-engineering of ETL pipelines and data models.
Key Requirements
- 8–10 years of software/data engineering experience.
- 7+ years of hands-on SQL, Databricks, and ETL experience.
- Strong Python experience for data processing and Kafka ingestion.
- Hands-on experience with Azure Data Factory (ADF), DataStage, and Kafka.
- Experience with API data ingestion, NoSQL databases, and scalable data architecture.
- Knowledge of SSAS, Cognos, Tableau, and/or ThoughtSpot.
- Experience supporting AI/ML, analytics, or GenAI data initiatives is highly preferred.
- Strong experience with EDW modernization, data modeling, and ETL re-engineering.
Must Have: Databricks + Advanced SQL + Python + ETL + ADF/DataStage + Kafka + EDW/Data Modernization.
The ideal candidate is a hands-on Databricks Architect/Data Engineer who combines deep SQL and ETL expertise with modern cloud data engineering skills. You should be comfortable working across Databricks, Python, Kafka, ADF, DataStage, APIs, and enterprise data architecture, while helping transform legacy data platforms into a scalable foundation for AI and advanced analytics.