Lead Data Engineer with AI

Job Title: Lead Data Engineer with AI

Location: Remote

Duration: 12 Months + Extension

Bill Rate: $92/hr on C2C

Job Type: C2C/1099 Contract

Client: To Be Discussed Later

Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD
Job Description:

As a Senior Technical Lead on our Palantir practice, you will bridge the gap between solution architecture and hands-on engineering. You will lead a squad of developers and data engineers, own the technical delivery of Foundry pipelines and AIP-powered features, and ensure that what gets built matches what the Technical Architect has designed on time, at quality, and with robust Day-2 supportability.
You will take direct ownership of Palantir Foundry pipelines (Python Transforms, Foundry Rules, Ontology Objects), coordinate AIP Logic automations, manage developer workflows, and serve as the first line of technical triage for production issues.
Key Responsibilities :

Technical Delivery & Pipeline Ownership
Own end-to-end delivery of Palantir Foundry data pipelines, including ingestion, transformation, Foundry Rules (Java), and Ontology Object management.
Lead the implementation of AIP Logic automations for requirement extraction, answer matching, scoring, and LLM-based document processing workflows.
Design and maintain pipeline lineage, schedules, and monitoring to ensure data freshness and platform reliability.
Build and maintain integration connectors between Foundry and external systems Salesforce, Snowflake, REST APIs, and media sets.
Manage and troubleshoot compute modules (Docker-based C# programs) used for document export and Word generation workflows.
Team Leadership & Code Quality
Lead a team of 36 developers and data engineers, conducting code reviews, sprint planning, and technical mentoring.
Define coding standards, branching strategies, pull request processes, and repository hygiene for Foundry code repositories.
Translate architecture blueprints from Technical Architects into sprint-ready technical tasks with clear acceptance criteria.
Identify and resolve technical blockers, escalating to Palantir or architecture teams as needed with well-documented issue descriptions.
Day-2 Support & Operational Excellence
Serve as the technical lead for Day-2 support owning SOP runbooks, triage playbooks, and on-call readiness for Palantir-based platforms.
Monitor pipeline health, respond to PagerDuty alerts, resolve schema conflicts, credential failures, and build failures in production environments.
Proactively identify performance bottlenecks (e.g., long-running campaign builds, massive dataset joins) and drive optimization.
Lead Day-2 support training sessions for new team members and client stakeholders, covering system architecture, common failure modes, and escalation paths.
Collaboration & Stakeholder Communication
Work directly with Architects to validate technical designs and surface implementation risks early.
Engage with client technical counterparts and Palantir forward-deployed engineers to align on platform capabilities and best practices.
Provide clear, concise status updates on delivery progress, blockers, and technical risks to project leadership.
Required Qualifications
Technical Skills :

Palantir Foundry: Python Transforms, Pipeline Lineage, Schedules, Ontology Object design, Foundry Rules (Java), Media Sets.
Palantir AIP: AIP Logic, AIP Automations, LLM integration basics, AIP Evals familiarity.
Data Engineering: Data ingestion pipelines, schema management, Spark-based compute, incremental builds.
Integration: Salesforce, Snowflake, REST APIs, CDO data connection patterns.
Languages: Python (strong), Java (Foundry Rules), SQL (strong); C# or TypeScript a plus.
DevOps: Docker, Git branching, CI/CD for Foundry repositories, code review workflows.
Experience :

5 to 7 years of total experience in software engineering, data engineering, or platform development.
2+ years of hands-on experience with Palantir Foundry in production environments, including pipeline ownership.
Experience leading small engineering teams (36 people) in agile delivery environments.
Proven ability to support and troubleshoot complex data platforms in a Day-2 support capacity.
Experience with Salesforce or Snowflake integrations in enterprise settings preferred.
Preferred Qualifications
Experience with AI-powered document processing pipelines (OCR, PDF/Docx to Markdown, LLM-based extraction). Familiarity with Palantir AIP Evals, LLM-as-a-judge frameworks, and confidence scoring for AI outputs.
Knowledge of Foundry Rules Java pipeline patterns, including .addObjectRid, .addLinkRid, and MaterializeOntologyObject patterns.
Exposure to Campaign Lifecycle Management, lead management, or sales operations platforms.
Understanding computing modules, OpenXML SDK, or other programmatic document generation approaches.