Job Role: Sr. Data Architect Azure Databricks
Location: Dallas, TX (Work from Office 5 Days)
Rate: USD $73-77/hr on c2c
Duration: 4-6 Months
No of position: 1
Exp. Start date: 4th week of March
Year of Experience: 15-18 Years
Type: Contract
Experience:
- 15 18 years in Data & Analytics
- 10+ years as ETL / Data Architect
- 5 6 years as Azure Data Architect
Key Responsibilities:
- Define target Azure data platform architecture (Lakehouse / Modern Data Warehouse) aligned with enterprise standards.
- Lead architectural decisions across data ingestion, storage, processing, semantic/consumption, security, and governance layers.
- Create architecture artifacts including reference architectures, solution blueprints, data flows, and integration patterns.
- Architect and guide implementation of Azure Databricks workloads (batch and streaming) using Apache Spark (PySpark/Spark SQL) and Delta Lake.
- Define standards for notebooks, repositories, modular frameworks, job orchestration, error handling, and reprocessing strategies.
- Drive performance tuning and cost optimization strategies including partitioning, caching, joins, and cluster design.
- Define analytics-ready data modeling approaches (dimensional modeling, Data Vault, curated data marts).
- Establish canonical data definitions, KPI standardization, and reusable datasets for BI and analytics.
- Architect data ingestion and orchestration frameworks using Azure services such as Azure Data Factory, Synapse Pipelines, Event Hubs/Kafka, and API ingestion patterns.
- Design scalable pipelines for structured and semi-structured data (JSON, Parquet, Delta).
- Implement data governance standards including cataloging, lineage, PII protection, retention, encryption, and auditing.
- Establish data quality and observability frameworks including monitoring, logging, alerting, and SLA/SLO definitions.
- Implement CI/CD pipelines for data platform assets using Azure DevOps and Git.
- Lead architecture discussions and collaborate with business, engineering, security, and platform teams.
Required Skills:
Azure Databricks, Apache Spark (PySpark / Spark SQL), Delta Lake, Azure Data Factory, ADLS, Azure Synapse, Data Architecture, Data Modeling, Data Governance, CI/CD with Azure DevOps, Distributed Data Processing, Enterprise Data Platform Design.