Data Engineering Technical Lead - Azure/Databricks/Trading

  • Houston, TX
  • Posted 7 hours ago | Updated moments ago

Overview

On Site
$80 - $90
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
No Travel Required

Skills

Data Engineering Technical Lead
Lead Data Engineer
Azure Data Architect
Databricks Lead
Databricks
Delta Live Tables
DLT
Structured Streaming
PySpark
Python
SQL
Microsoft Azure
Azure Data Factory
ADF
Synapse
ADLS
Stream Analytics
Unity Catalog
Data Pipeline
Trading
ETRM
Oil
Gas
Commodity Data
Analytics
Data Lakehouse
Team Lead
Data Governance
Metadata
Data Lineage
Pipeline Performance
Cost Optimization
Cloud
Real-Time Data
CI/CD
Kafka
PowerBI
QlikSense
Hadoop
Airflow
Data Quality
Mentor
Executive Communication
Digital Transformation

Job Details

Job Title: Data Engineering Technical Lead - Azure/Databricks/Trading
Location: Houston, TX

Duration: 12 Months

 

Summary:
Be a hands-on architect and technical lead, designing and delivering robust data platforms for trading and analytics using Databricks (Delta Live Tables, Structured Streaming), PySpark, and the Azure ecosystem including ADF, Synapse, ADLS, and Unity Catalog.

 

Key Responsibilities:

  • Architect/implement scalable Azure Data Lakehouse solutions; lead Databricks DLT and PySpark pipeline development
  • Build high-volume, real-time data streaming processes for trading analytics
  • Tune pipeline and resource performance for optimal cost and efficiency
  • Drive data governance, data lineage (Unity Catalog), and quality/monitoring practices
  • Integrate and manage data flows from ETRM/trading systems for oil/gas analytics
  • Collaborate with traders, analysts, and business/IT teams on actionable solutions
  • Mentor and lead a diverse team; upskill across cloud and data engineering tech
  • Communicate with executives and stakeholders, turning technical concepts into business strategy

 

Required Skills:

  • 12+ years in data engineering/analytics, 3+ years Databricks DLT/Structured Streaming
  • Deep Azure data stack experience (ADF, Synapse, ADLS, Stream Analytics, Unity Catalog)
  • Python, PySpark, strong SQL; performance optimization expertise
  • Experience with trading/ETRM data, commodity analytics
  • Demonstrated leadership, project ownership, and executive communicator
  • Bachelor s/Master s in Computer Science, IT, or related; Azure Data Engineering, Databricks certs preferred

 

Nice to Have:

  • Kafka, Hadoop, Airflow, PowerBI/QlikSense
  • Exposure to AI/ML, GenAI, Agile, CI/CD

 

Keywords: Data Engineering Technical Lead, Lead Data Engineer, Azure Data Architect, Databricks Lead, Databricks, Delta Live Tables, DLT, Structured Streaming, PySpark, Python, SQL, Microsoft Azure, Azure Data Factory, ADF, Synapse, ADLS, Stream Analytics, Unity Catalog, Data Pipeline, Trading, ETRM, Oil, Gas, Commodity Data, Analytics, Data Lakehouse, Team Lead, Data Governance, Metadata, Data Lineage, Pipeline Performance, Cost Optimization, Cloud, Real-Time Data, CI/CD, Kafka, PowerBI, QlikSense, Hadoop, Airflow, Data Quality, Mentor, Executive Communication, Digital Transformation

 

About VDart Group
VDart Group is a global leader in technology, product, and talent solutions, serving Fortune 500 clients in 13 countries. With over 4,000 professionals worldwide, we deliver innovation, operational excellence, and measurable outcomes across industries. Guided by our commitment to People, Purpose, and Planet, VDart is recognized with an EcoVadis Bronze Medal and as a UN Global Compact member, reflecting our dedication to sustainable practices.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About VDart, Inc.