Overview
Skills
Job Details
Job Title: Senior Data Engineer
Location: Houston, TX - Hybrid - Local Candidates Only
Type: Long-Term Contract
Overview:
Lead migration from Palantir Foundry to a modern Snowflake stack by developing reliable ELT pipelines, rebuilding transformations, and ensuring data accuracy and readiness for cutover.
Experience:
7+ years total; 3+ years with Snowflake.
Key Responsibilities:
-
Extract/export historical Palantir data to S3/ADLS and load into Snowflake with reconciliation controls.
-
Recreate Foundry logic using dbt/Snowflake SQL; build curated and incremental models.
-
Develop batch event/rules engine for time-series data.
-
Orchestrate workflows via Airflow (AKS) and Snowflake Tasks; monitor and document operations.
-
Optimize performance, cost, and resource usage in Snowflake.
-
Implement automated data tests and ensure parity with legacy outputs.
-
Collaborate with BI teams (Sigma, Power BI) for performance and security alignment.
Required Skills:
-
Strong Snowflake SQL & Python for ELT and validation.
-
Production experience with dbt, Airflow, Snowflake Tasks/Streams.
-
Expertise with S3/ADLS, Parquet/CSV, Snowpipe, External Tables.
-
Git-based CI/CD, data quality checks, and performance tuning.
Preferred:
-
Migration experience (Palantir, Cloudera, Hive, Spark).
-
Familiarity with Trino, Snowpark, or UDFs.
-
BI integration (Sigma, Power BI).
-
Snowflake security (RBAC, masking), governance, and AKS/container exposure.