Requisition Title: Data Engineer - Remote
Location: Oakland, CA (San Francisco, CA)
This role supports OEIS compliance reporting by building auditable, Foundry native data pipelines and data checker frameworks. The engineer will be responsible for compliance transformations, validation logic, and traceable outputs that meet regulatory and audit requirements.
Core Responsibilities
Design and maintain Palantir Foundry pipelines for OEIS compliance reporting
Build and maintain data checker / validation frameworks within Foundry Develop PySpark and Spark SQL transformations for large-scale datasets Implement compliance driven checks (completeness, consistency, reconciliation, exception flags)
Ensure full data lineage, auditability, and reproducibility of compliance datasets
Partner with compliance SMEs and stakeholders to validate logic and reporting outputs
Support operational monitoring, issue triage, and data quality remediation
Required Technical
Skills
Strong Python
PySpark / Spark SQL
Advanced SQL
Hands-on experience with Palantir Foundry Experience building data validation, QA, or data quality frameworks Understanding of compliance, audit, or regulatory reporting requirements
Preferred / Nice to Have
Experience with OEIS or regulatory compliance reporting Foundry Workshop experience working with ontology-driven or curated datasets Utility, infrastructure, or asset-based domain experience
Never miss an opportunity! Create an alert based on the job you applied for.
