Lead Databricks Integration Architect

job summary:

Randstad is seeking a hands-on Lead Solutions Architect specializing in Databricks and Application Integration on behalf of our client in Washington, D.C. This practitioner-level leader will create and execute the technical blueprints that link the enterprise Databricks platform directly to downstream operational applications, microservices, business intelligence tools, and external APIs. Acting as a hands-on mentor and technical authority, this architect will build reusable platform libraries, lead engineering code reviews, and optimize real-time streaming data pipelines. This position operates under a SAFe (Scaled Agile) framework with a hybrid schedule, requiring on-site attendance for critical ceremonies like PI planning in Washington, D.C.

location: Washington, Washington, D.C.

job type: Contract

salary: $75 - 85 per hour

work hours: 9am to 5pm

education: Bachelors



responsibilities:

Hands-on Integration Blueprinting: Design, document, and actively build end-to-end integration patterns utilizing Databricks Delta Live Tables (DLT), structured streaming, and core APIs to connect data with enterprise software.

Framework & Code Library Development: Partner with Core Platform and Cloud Infrastructure teams to write reusable platform libraries and abstraction layers that speed up development cycles.

Data Quality Mechanics: Architect and enforce technical data quality frameworks, including automated DLT "Expectations" templates and granular data lineage tracking.

Mentorship & Code Reviews: Lead architectural review boards, oversee peer code/design reviews, and provide direct technical mentorship to mid-and-senior data engineers.

Performance Tuning (FinOps): Implement technical optimization strategies (Z-Ordering, Liquid Partitioning, Photon compute) to balance data throughput with cloud processing costs.

CI/CD Lifecycle Governance: Design and govern multi-tier code deployment strategies (Dev, Test, Stage, Prod) for Databricks assets and automated Infrastructure as Code (IaC).

qualifications:

Professional Experience: 8+ years of experience in IT solution architecture, application design, or senior-level data engineering, with a history of building integrated cloud data ecosystems.

Hands-on Databricks & Language Mastery: Authoritative, hands-on engineering experience using the Databricks platform, PySpark, SQL, and core Delta Lake concepts.

Advanced DLT & Streaming Expertise: Deep technical proficiency building and blueprinting complex Delta Live Tables (DLT) architectures and real-time structured streaming solutions.

Enterprise Data Modeling: Expert-level understanding of designing relational, dimensional, and Medallion (Bronze/Silver/Gold) configurations optimized for multi-application consumption.

Automation & CI/CD Architecture: Strong experience designing enterprise deployment strategies and automated infrastructure provisioning using Git, Azure DevOps, GitHub Actions, or Terraform.

Collaborative Leadership: Exceptional capability to lead technical squads, drive consensus across engineering teams, and clearly explain technical roadmaps to non-technical stakeholders.

Agile Integration: Ability to thrive in a SAFe (Scaled Agile) environment, including full commitment to iteration planning and on-site PI planning in Washington, D.C.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.