Data Engineer / Architect

Overview

Remote
$175,000 - $175,000
Full Time

Skills

databricks
unity catalog
pyspark
data factory

Job Details

*Full Remote in designated states below | Direct Hire | No C2C

Data Engineer / Architect Databricks & Unity Catalog

We re looking for a hands-on Data Engineer/Architect to lead modernization efforts within a cloud-based data environment. This role blends deep technical execution with architectural input, focusing on refactoring legacy platforms, optimizing pipelines, and aligning with Databricks and Unity Catalog standards. Approximately 80% of the work will be hands-on development, with the remainder dedicated to design, architecture, and mentoring.

Key Responsibilities

  • Design and implement scalable, secure, and compliant data architectures and migration strategies.
  • Modernize legacy systems and drive cloud-native solutions using Azure, Databricks, Delta Lake, PySpark, Spark Streaming, Synapse, and Data Factory.
  • Develop and optimize data pipelines for ingestion, transformation, and integration across diverse sources.
  • Establish and maintain governance, lineage, and quality frameworks across data assets.
  • Collaborate with engineering, operations, and analytics teams to deliver business-driven data solutions.
  • Provide mentorship and technical leadership, contributing to architectural discussions and best practices.

Qualifications

  • 10 15+ years in data engineering and/or data architecture, including 5+ years with Databricks and Unity Catalog.
  • Proven experience leading legacy-to-cloud migrations and modern data platform transformations.
  • Strong expertise in data modeling (relational, dimensional, lakehouse), SQL/T-SQL, and Azure data services.
  • Proficiency in DevOps, CI/CD, pipeline orchestration, and Agile delivery.
  • Experience with REST APIs, serverless functions, and large-scale ingestion and performance tuning.
  • Bachelor s or Master s in Computer Science, Engineering, or a related field.

Preferred: Background in healthcare or other regulated industries, familiarity with real-time streaming and event-driven architectures, and the ability to communicate technical concepts to diverse audiences.

Ideal Candidate

You re a builder who thrives in evolving environments able to balance deep technical work with system-level design. You bring a collaborative mindset, mentor others, and deliver reliable solutions that scale. You take ownership, communicate clearly, and see modernization as both a technical and cultural evolution.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.