Data Bricks Architect

Job Title: Data Bricks Architect
Location: 100% Remote
Type: Contract W2

About the Role:

We are seeking a highly skilled Data Bricks Architect with deep expertise in building, optimizing, and managing large-scale data and AI solutions on Azure and AWS platforms. The ideal candidate will have a strong background in Data Bricks, advanced analytics, and AI-driven architectures, with proven experience in RAG (Retrieval Augmented Generation), model engineering, and prompt engineering.

Key Responsibilities:

• Design, architect, and implement end-to-end data and AI solutions leveraging Databricks on Azure and AWS.
• Lead data pipeline development, data modeling, and large-scale ETL/ELT workflows.
• Develop and optimize RAG-based architectures to integrate large language models with enterprise data sources.
• Drive model engineering and prompt engineering initiatives for AI/ML solutions.
• Collaborate with data scientists, ML engineers, and business stakeholders to define scalable AI use cases.
• Ensure data governance, security, and compliance across multi-cloud environments.
• Provide technical leadership and best practices for data and AI strategy.

Required Skills & Qualifications:

• 4+ years of hands-on expertise in Data Bricks on both Azure and AWS.
• Strong experience in data engineering, data analytics, and data architecture.
• Proven background in AI/ML, with specific expertise in RAG, model engineering, and prompt engineering.
• Proficiency in Python, SQL, and Spark.
• Solid understanding of cloud-native services (Azure Data Lake, AWS S3, Synapse, Redshift, etc.).
• Experience with MLOps, deployment pipelines, and model lifecycle management.
• Strong problem-solving, communication, and leadership skills.

Preferred Qualifications:

• Experience with generative AI frameworks and LLM integrations.
• Exposure to data visualization tools (Power BI, Tableau, etc.).
• Certifications in Azure Data Engineer/Architect or AWS Data Analytics/Architect.