Data Bricks on AWS Platform Architect


VeridianTech
Dice Job Match Score™
🔢 Crunching numbers...
Job Details
Skills
- DataBricks Platform Administrator /Databricks Certified Data Engineer/ AWS Certification (DevOps/Solution Architect) Terraform
Summary
7+ MONTH
This is a temp to perm role
Skills (EXPERT/ADVANCED/NONE)
Databricks on AWS Platform Engineer Platform Architecture
Architect and manage a secure, scalable, and highly available Databricks Lakehouse Platform on AWS.
Design data platforms leveraging AWS S3, Delta Lake, Unity Catalog, and Databricks Workspaces for enterprise analytics and AI.
Define networking architecture including VPC, PrivateLink, IAM roles, security groups, and encryption standards.
Establish multi-environment strategies (Dev, Test, UAT, Prod) with automated provisioning through Terraform and Infrastructure as Code (IaC).
Implement enterprise-wide data governance, lineage, metadata management, and compliance controls using Unity Catalog.
Design high-performance data ingestion and processing architectures supporting batch, streaming, and real-time analytics workloads.
Enable AI and GenAI capabilities through Mosaic AI, Vector Search, Model Serving, AI/BI Dashboards, and Genie Spaces.
Define CI/CD, monitoring, logging, and observability frameworks using GitHub, Jenkins, CloudWatch, and Databricks Workflows.
Optimize platform performance, reliability, scalability, and cloud costs through FinOps and workload optimization practices.
Questions (must answer YES to ALL)
Do you have Databricks on AWS Platform Engineer Platform Architecture
Are you local to one of the locations listed?
Do you have certification on DataBricks Platform Administrator /Databricks Certified Data Engineer/
Do you have certification on AWS Certification (DevOps/Solution Architect)
Provide architectural leadership and best practices for Lakehouse modernization, advanced analytics, AI governance, and enterprise data platform adoption.
Do you have Databricks, AWS S3,
Do you have Delta Lake
Do you have Unity Catalog, Spark/PySpark, Terraform, GitHub, CI/CD, CloudWatch, Mosaic AI, Genie, Vector Search, MLflow, Kafka, Airflow, Kubernetes.
Description:
UPDATED NOTES ON REQ FROM 8/21
Architect and manage a secure, scalable, and highly available Databricks Lakehouse Platform on AWS.
Design data platforms leveraging AWS S3, Delta Lake, Unity Catalog, and Databricks Workspaces for enterprise analytics and AI.
Define networking architecture including VPC, PrivateLink, IAM roles, security groups, and encryption standards.
Establish multi-environment strategies (Dev, Test, UAT, Prod) with automated provisioning through Terraform and Infrastructure as Code (IaC).
Implement enterprise-wide data governance, lineage, metadata management, and compliance controls using Unity Catalog.
Design high-performance data ingestion and processing architectures supporting batch, streaming, and real-time analytics workloads.
Enable AI and GenAI capabilities through Mosaic AI, Vector Search, Model Serving, AI/BI Dashboards, and Genie Spaces.
Define CI/CD, monitoring, logging, and observability frameworks using GitHub, Jenkins, CloudWatch, and Databricks Workflows.
Optimize platform performance, reliability, scalability, and cloud costs through FinOps and workload optimization practices.
Provide architectural leadership and best practices for Lakehouse modernization, advanced analytics, AI governance, and enterprise data platform adoption.
Core Technologies: Databricks, AWS S3, Delta Lake, Unity Catalog, Spark/PySpark, Terraform, GitHub, CI/CD, CloudWatch, Mosaic AI, Genie, Vector Search, MLflow, Kafka, Airflow, Kubernetes.
Certification :
DataBricks Platform Administrator /Databricks Certified Data Engineer/
AWS Certification (DevOps/Solution Architect)
Terraform
- Dice Id: 91120142
- Position Id: 2026-18590
- Posted 1 day ago
Company Info
About VeridianTech
Veridian Tech Solutions Houston based Cloud Consulting and IT Services firm specializing in Enterprise Mobility, Information Management, and Cloud-based solutions.
Founded in 2013, Veridian Tech Solutions was created to address the growing need for technology that enables businesses to be mobile and flexible in managing their applications and employees. As the market began transitioning into the Digital Era, Veridian realized that companies needed specific skill sets of technology expertise to provide their customers with new tools and services, create better ways for their employees to do their jobs, and do so in a modern, cost-effective way.
With decades of industry experience, Veridian's leadership team brought the expertise and guidance of extensive enterprise systems execution and project management expertise across numerous industries, and most importantly, the knowledge of what is required for a consultant to be effective.
Veridian builds its team by only selecting resources who have deep consulting experience, proven technical skills, and are highly proficient in specific sought-after areas of cutting-edge Mobility, Cloud, and Analytics technologies.
These cutting-edge skills we have often found are the gaps at organizations across North America, from mid-tier to Fortune 500, and at big 4 consulting firms as well. We work with our clients to comprehend their project requirements and utilize our experience to present the correct solutions and right resources.
We provide onshore services to North America, coordinated from our headquarters in Houston, and we provide offshore services from our Delivery center in New Delhi, India.
Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs