Data Platform Engineer

Data Platform Engineer - Enterprise Data Modernization & Assessment

Remote role

Compensation: $70 - $80 per hour
ABOUT THE ROLE

Our client, a leading academic medical center, is embarking on the first phase of a large-scale enterprise data modernization initiative. We are seeking an experienced Data Platform Engineer to play a pivotal role in technical discovery, workload analysis, automation, and migration planning-distinct from traditional pipeline development. In this role, you will assess how Epic Clarity and Caboodle data is accessed, consumed, and utilized across the organization, and help define the future-state architecture within Databricks. You will design and operate AI-assisted query classification processes, map existing database objects to a modern Databricks-based analytics platform, and identify functional gaps to inform the migration roadmap. This is a unique opportunity to shape the organization's data modernization strategy, ensuring a scalable and efficient transition to modern analytics solutions. The ideal candidate thrives on solving complex architectural challenges, has a strong background in automation and cloud-based analytics, and is passionate about enabling data-driven transformation in healthcare environments.
WHAT YOU'LL DO

• Design, build, and maintain automated AI-assisted query-log classification pipelines to categorize enterprise database access patterns.
• Analyze SQL query activity, reporting workloads, extracts, integrations, and downstream data consumption to identify migration candidates.
• Own the mapping of Epic Clarity and Caboodle database objects to future-state Databricks architecture, identifying functional gaps and providing recommendations for future implementation.
• Perform technical assessments of tables, views, stored procedures, functions, and other database objects to determine migration feasibility and modernization strategies.
• Develop automation to accelerate discovery, object analysis, metadata collection, workload classification, and migration planning.
• Collaborate with Identity & Access Management resources to correlate access patterns with database object utilization and support enterprise access rationalization.
• Partner with business stakeholders to understand analytical workflows, reporting requirements, and downstream application dependencies.
• Evaluate legacy SQL objects and recommend scalable, cloud-native design patterns within Databricks.
• Produce technical documentation, migration recommendations, object inventories, and architectural assessments to guide future implementation phases.
• Provide engineering expertise to support enterprise data governance, modernization strategy, and analytics platform transformation.

WHAT YOU BRING

• 5+ years of experience as a Data Platform Engineer, Data Engineer, Analytics Engineer, Data Architect, or similar role.
• Epic Clarity Data Model Certification and/or Epic Caboodle Certification.
• Demonstrated experience supporting multiple enterprise-scale data platform modernization or migration initiatives.
• Hands-on experience with Databricks and modern lakehouse architecture.
• Strong SQL development skills with experience analyzing complex database workloads and query patterns.
• Proven experience building automation using Python, PySpark, SQL, or similar technologies to improve operational efficiency and reduce manual analysis.
• Experience evaluating legacy data platforms and developing migration strategies for cloud-based analytics environments.
• Strong understanding of relational database architecture, metadata, database objects, and enterprise data modeling.
• Experience assessing existing reporting or analytics environments and translating legacy database structures into modern cloud architectures.
• Strong analytical, troubleshooting, and critical thinking skills with the ability to solve complex technical challenges independently.
• Excellent written and verbal communication skills with the ability to explain technical findings to both technical and non-technical stakeholders.
• Experience working with Epic Clarity and/or Epic Caboodle data environments.
• Experience supporting healthcare organizations or academic medical centers.
• Experience designing AI-assisted automation or machine learning workflows for data engineering, metadata discovery, or workload classification.
• Experience with Azure cloud services and enterprise analytics platforms.
• Familiarity with Power BI, Tableau, and modern enterprise reporting ecosystems.
• Experience supporting Oracle-to-cloud modernization initiatives.
• Knowledge of enterprise data governance, metadata management, and data cataloging practices.

WHAT'S IN IT FOR YOU

• Opportunity to shape the data modernization roadmap for a leading academic medical center.
• Work remotely with a collaborative, forward-thinking team.
• Engage in high-impact projects leveraging the latest in cloud, AI, and analytics technologies.
• Competitive hourly compensation.
• Potential for long-term engagement and professional growth in healthcare data engineering.