Overview
On Site
$65 - $70
Contract - Independent
Contract - 12 Month(s)
No Travel Required
Skills
Kafka
Event Hubs
data mesh
data fabric
or federated data architecture.
Job Details
Hi
One of our client is looking for a Senior Data Engineer (Contract) Houston, TX (4 Days Onsite, 1 Day Remote)
If interested please share your updated resume.
Duration: 12+ Months (Contract, potential to extend)
Location: Houston, Texas 4 days onsite, 1 day remote
Experience: 13+ Years (Data Engineering, Data Architecture, Oil & Gas preferred)
Start Date: ASAP
About the Role
We are seeking a highly experienced Senior Data Engineer / Data Architect (Contract) with strong hands-on skills in Azure, AWS, ADF, Databricks, Fabric, and Data Modeling, ideally with prior Oil & Gas trading domain experience. This is a hybrid techno-functional role you ll work closely with business stakeholders, architects, and analytics teams to deliver scalable, enterprise-grade data solutions.
You will also play a key part in advancing our AI/ML and Data Cataloging capabilities, including implementing Natural Language Search over enterprise data assets.
Key Responsibilities
Lead the design, development, and deployment of robust data pipelines, ETL/ELT workflows, and data models on Azure and AWS cloud environments.
Architect and optimize data solutions using ADF (Azure Data Factory), Databricks, and Microsoft Fabric.
Partner with data architects, BI/analytics teams, and business SMEs to translate business requirements into scalable data solutions.
Drive data modeling, data design, data governance, and metadata management best practices.
Implement and integrate AI/ML-based solutions for data cataloging, including natural language search over data catalogs, lineage, and enterprise data assets.
Develop and document data architecture and data integration patterns (batch and real-time).
Champion techno-functional communication: bridge the gap between technology teams and business (especially in the Oil & Gas trading domain).
Ensure data quality, security, and compliance across cloud and hybrid environments.
Mentor junior data engineers and collaborate cross-functionally.
Required Skills & Qualifications
10+ years of hands-on experience in Data Engineering, Data Architecture, or similar roles.
Strong experience in Azure (Data Lake, ADF, Synapse, Fabric) and AWS data services.
Expertise in Databricks (Spark, Delta Lake, Notebooks, MLflow, etc.).
Deep skills in Data Modeling, Data Design (relational, dimensional, lakehouse, etc.).
Proven track record in the Oil & Gas trading sector (essential upstream, downstream, or trading exposure highly preferred).
Solid background in building scalable ETL/ELT pipelines using ADF and Databricks.
Experience implementing or integrating AI/ML models for data management (e.g., natural language query over data catalog, automated data discovery/classification).
Familiarity with data cataloging tools (e.g., Azure Purview, Informatica, Alation, Collibra, Unity Catalog, etc.).
Knowledge of Microsoft Fabric (or willingness to upskill quickly).
Techno-functional skills: ability to communicate effectively with both technical and business stakeholders.
Experience in data security, governance, and compliance.
Strong SQL, Python, and Spark skills; experience with APIs, REST, and integration patterns.
Excellent problem-solving, documentation, and team collaboration skills.
Bachelor s or Master s in Computer Science, Engineering, or related field.
Preferred/Bonus Skills
Experience with Natural Language Processing (NLP), LLMs, or GenAI for search/analytics use cases.
Exposure to real-time data streaming (Kafka, Event Hubs).
Prior work with data mesh, data fabric, or federated data architecture.
Certifications in Azure, AWS, or Databricks.
Note: This is an immediate requirement. Candidates must be local or willing to relocate to Houston, TX. Sponsorship not available for this contract role .
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.