Senior Data Engineer (Palantir Foundry) Banking Domain

Job Title: Senior Data Engineer (Palantir Foundry) Banking Domain
Location: Remote | Experience: 5 7 Years (Palantir Focus)

Duration: 12 Months

Job Summary

The Senior Data Engineer will architect and optimize Palantir Foundry data pipelines for banking/financial services, transforming complex transactional datasets into ontology-driven insights. This role owns ETL/ELT pipeline design, data harmonization, ontology management, and performance optimization to support regulatory compliance, risk analytics, and business intelligence.

Key Responsibilities

Pipeline Architecture

• Design scalable ETL/ELT pipelines using Foundry Code Repositories (Python/PySpark), Pipeline Builder, and Data Connection tools.
• Implement incremental processing, change data capture (CDC), and backfill strategies for banking datasets (transactions, KYC/AML, positions).
• Optimize Spark execution for cost efficiency and low latency across large-scale financial workloads.

Ontology Management

• Collaborate with domain experts to design banking-specific ontologies (Accounts, Transactions, Counterparties, Risk Exposures, Regulatory Entities).
• Maintain object types, link types, and action types ensuring data relationships accurately reflect business logic.
• Implement data lineage, ownership, and audit trails for compliance and governance.

Data Transformation & Quality

• Use PySpark and SQL transforms to harmonize disparate sources (core banking, trade systems, market data, external feeds).
• Build data quality rules, validation pipelines, and monitoring dashboards using Foundry's built-in governance tools.
• Implement deduplication, standardization, and enrichment for Golden Record creation.

Performance & Optimization

• Conduct deep-dive compute profiling and optimize warehouse sizing, clustering keys, and materialized views.
• Implement caching strategies, pre-aggregation, and incremental builds to minimize costs.
• Design schedule dependencies and orchestration patterns for complex pipeline topologies.

Technical Qualifications

Palantir Foundry Mastery (5 7 Years)

Core Tools:

• Code Repositories: Python, PySpark transforms
• Pipeline Builder: ETL orchestration
• Data Connection: External system integration
• Ontology Manager: Object/link design
• Code Workbook: Ad-hoc analysis
• Fusion Sheets: Business user enablement

Technical Stack

• Languages: Python, PySpark, SQL (expert)
• Distributed: Spark optimization, partitioning strategies
• Cloud: AWS S3, Azure Data Lake, Google Cloud Platform (Foundry hosted)
• Banking: Transactional data, KYC/AML, risk datasets
• Governance: Lineage, quality rules, audit compliance

Banking Domain Focus (Preferred)

• Transaction Processing: Core banking, payments, settlements
• KYC/AML: Customer/PEP screening, sanctions lists
• Risk Management: Credit, market, operational risk data
• Regulatory: CCAR, Basel, Dodd-Frank reporting
• Wealth Management: Positions, NAV, performance attribution

Professional Skills

• Agile/Scrum: Sprint planning, backlog grooming, delivery cadence.
• Stakeholder Communication: Translate banking requirements into Foundry ontology/solutions.
• Troubleshooting: Root cause analysis across complex data pipelines.
• Documentation: Pipeline design, ontology specs, runbooks.

Keywords: Senior Data Engineer, Palantir Foundry, Foundry Data Engineer, PySpark, Python, SQL, Data Pipeline, ETL, ELT, Ontology, Data Connection, Code Repository, Pipeline Builder, Data Transformation, Data Quality, Data Governance, Data Lineage, Spark Optimization, Banking Data, Financial Services, Transactional Data, KYC, AML, Risk Management, Regulatory Reporting, Agile Data Engineering, Cloud Data Engineering, AWS S3, Azure Data Lake, Google Cloud Platform BigQuery

About VDart Group
VDart Group is a global leader in technology, product, and talent solutions, serving Fortune 500 clients in 13 countries. With over 4,000 professionals worldwide, we deliver innovation, operational excellence, and measurable outcomes across industries. Guided by our commitment to People, Purpose, and Planet, VDart is recognized with an EcoVadis Bronze Medal and as a UN Global Compact member, reflecting our dedication to sustainable practices.