Databricks Architect - Full Time role
Visionary Innovative Technology Solutions
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- Apache Spark
- Automated Testing
- Continuous Delivery
- Continuous Integration
- Data Engineering
- Data Governance
- Databricks
- ELT
- Extract, Transform, Load
- Real-time
Summary
Lead the design and architecture of scalable data solutions using Databricks, Delta Lake, Unity Catalog, and Medallion Architecture.
Own end-to-end delivery of data engineering initiatives and provide technical direction to engineering teams.
Design, develop, optimize, and review ETL/ELT pipelines for performance, scalability, and maintainability.
Build real-time and streaming data solutions using Spark Structured Streaming and Delta Live Tables.
Implement Databricks capabilities such as Auto Loader, Lakeflow Connect, and Lakeflow Declarative Pipelines.
Optimize Databricks workloads, compute utilization, and platform costs.
Establish standards for CI/CD, automated testing, monitoring, observability, and data governance.
Implement infrastructure and deployment automation using Terraform and/or Databricks Asset Bundles.
- Dice Id: 91020323
- Position Id: 9123805
- Posted 5 hours ago
Company Info
VITS provide staffing and recruitment services along with technology consulting to more than 50+ clients globally Our skilled & expertise professionals help clients to manage varying skill needs, skills gaps and changing staffing needs to encounter project deadlines. VITS staff augmentation services provide skilled resources which assist clients to develop, maintain, manage and support their applications. Our vigorous pursuit for excellence in hiring, delivery model, work ethics, and approach has enabled us to become a highly trusted & preferred recruitment solution provider.