Overview
On Site
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 7 day((s))
100% Travel
Skills
Medallion
Designing pipelines
Job Details
Data Engineering with Medallion Architecture
Designing pipelines that move data from Bronze Silver Gold Implementing schema evolution, CDC, and data quality checks
Understanding standards for each layer (e.g., Bronze = raw, Gold = curated KPis)
Spark and SQL Expertise
Writing performant Spark SQL and PySpark transformations
Optimizing joins, window functions, and aggregations
Handling large-scale data with partitioning and caching strategies
Delta Live Tables (DLT) and Workflows
Lakeflow Declarative Pipelines
DevOps and CI/CD
Using Databricks Asset Bundles (DABs) for deployment
Integrating with Git, Bitbucket, and Jenkins for version control and automation
Designing pipelines that move data from Bronze Silver Gold Implementing schema evolution, CDC, and data quality checks
Understanding standards for each layer (e.g., Bronze = raw, Gold = curated KPis)
Spark and SQL Expertise
Writing performant Spark SQL and PySpark transformations
Optimizing joins, window functions, and aggregations
Handling large-scale data with partitioning and caching strategies
Delta Live Tables (DLT) and Workflows
Lakeflow Declarative Pipelines
DevOps and CI/CD
Using Databricks Asset Bundles (DABs) for deployment
Integrating with Git, Bitbucket, and Jenkins for version control and automation
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.