Role Summary
Senior Databricks Data Ingestion Engineer to build production-grade, compliant ingestion pipelines for a high-growth technology company preparing for enterprise and SOX-aligned readiness.
This role focuses on reliable, auditable data ingestion on Databricks, aligned with the customer s engineering standards, security controls, and operational requirements. The engineer will work closely with the customer s data and platform teams to deliver pipelines built for scale, governance, and long-term operations.
Key Responsibilities
Design and implement Databricks-based ingestion pipelines using Delta Lake
Build incremental, restartable, and schema-aware ingestion patterns
Adhere to customer-defined engineering standards (code structure, CI/CD, reviews, documentation)
Implement logging, monitoring, and operational controls for ingestion workflows
Ensure ingestion pipelines meet security, access control, and auditability requirements
Collaborate daily with customer engineers and escalate risks early
Required Experience
10+ years in data engineering, with strong focus on ingestion preferably in healthcare data domain
Hands-on production experience with Databricks and Delta Lake
Experience ingesting data from databases, files, and APIs
Strong discipline around enterprise engineering standards and compliance
Experience operating in regulated or audit-sensitive environments
Nice to Have
SOX or IPO-readiness experience
Data observability or data quality tooling exposure
Experience in embedded or staff-augmentation models
Never miss an opportunity! Create an alert based on the job you applied for.
