Search Jobs | Dice.com

Job Details

Skills

Partnership
Collaboration
Cash Flow
Streaming
Energy
Advanced Analytics
Analytical Skill
Use Cases
Data Quality
Business Operations
Performance Tuning
Physical Data Model
Reporting
DevOps
Management
Extract
Transform
Load
SQL
Software Development
Software Engineering
Development Testing
Version Control
Code Refactoring
Python
Data Engineering
Pandas
NumPy
scikit-learn
Apache HTTP Server
High-level Design
Data Modeling
Data Governance
Regulatory Compliance
Apache Airflow
Kubernetes
Amazon S3
Storage
Amazon Web Services
Snow Flake Schema
IaaS

Partnership
Collaboration
Cash Flow
Streaming
Energy
Advanced Analytics
Analytical Skill
Use Cases
Data Quality
Business Operations
Performance Tuning
Physical Data Model
Reporting
DevOps
Management
Extract
Transform
Load
SQL
Software Development
Software Engineering
Development Testing
Version Control
Code Refactoring
Python
Data Engineering
Pandas
NumPy
scikit-learn
Apache HTTP Server
High-level Design
Data Modeling
Data Governance
Regulatory Compliance
Apache Airflow
Kubernetes
Amazon S3
Storage
Amazon Web Services
Snow Flake Schema
IaaS

Summary

Description

Tap into the professional possibilities of the largest publicly traded energy partnership that features one of the most diversified cash flow streams in the midstream segment of the energy industry. With dynamic career opportunities and a creative and supportive environment, our unique midstream energy organization offers the chance to share and be recognized for your ideas. Join our team and increase your opportunities for success.

We are currently seeking an experienced Data Engineer to join the Big Dat and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for the midstream oil and gas operations, engineering, and measurements business units. Responsibilities include, but are not limited to:

Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse.
Design and implement data quality pipelines to ensure data correctness and building trusted datasets.
Design and implement a Data Lakehouse solution which accurately reflects business operations.
Assist with data platform performance tuning and physical data model support including partitioning and compaction.
Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives.
Automate and optimize the data lifecycle, find insights from raw data, and applying DevOps principle to data pipelines.
Work with business leaders to deliver custom software solutions meeting data needs.
Build and support a data platform for data engineering teams to build, deploy and manage applications.

Qualifications

The successful candidate will meet the following qualifications:

5+ years of experience as a Data Engineer designing and maintaining data pipeline architectures.
5+ years of in-depth programming experience in Python and SQL.
5+ years in software development lifecycle experience with software engineering, development, testing, version control, refactoring, and deployment.
Experience with common Python Data Engineering packages including pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3.
Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake.
Experience with data platform architecture responsible for high-level design, strategy and implementation of data infrastructure, including data modelling, designing scalable architectures and ensuring data governance, security and compliance.
Knowledgeable of modern data platform technologies including Apache Airflow, Kubernetes, and S3 Object Storage.
Experience with AWS, Snowflake, dbt and Airbyte is preferred.
Experience with infrastructure as code, building consistent and repeatable cloud infrastructure.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10169261
Position Id: 1c246841d2054c78a518f04e9796c040
Posted 30+ days ago

Fitment

Dice Job Match Score™

🧠 Analyzing your skills...

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Houston, Texas

•

Today

STRATEGIC STAFFING SOLUTIONS HAS AN OPENING! This is a Contract Opportunity with our company that MUST be worked on a W2 Only. No C2C eligibility for this position. Visa Sponsorship is Available! The details are below. Beware of scams. S3 never asks for money during its onboarding process. Job Title: Data Engineer Location: Houston, TX Contract Length: 12+ Months Pay: 80-90 per hr on W2 Job ref# 247245 Seeking a Senior Data Engineer to support Enterprise AI initiatives within the Shale & Tigh

Easy Apply

Full-time, Contract

USD0 - USD0

Senior Data Engineer ID75059

Texas City, Texas

•

Today

Job Description AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to d

Full-time

Junior Data Engineer - (Canada-based)

No location provided

•

Today

Who we are Artefact is a new generation of a data service provider, specializing in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organizations. We are proud to say that we're enjoying skyrocketing growth. Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients' specific needs, always conceived with a business-centric approach and delivered with t

Full-time

Data Engineer

Remote

•

Today

At Gopuff, data sits at the heart of our strategy. We are reimagining how people purchase everyday essentials, from snacks to household goods to alcohol, all delivered in minutes. To fuel this mission, we are seeking a Data Engineer to design, build, and scale the data systems that power insights, experimentation, and operational excellence across the company. As a Data Engineer, you will play a critical role in shaping Gopuff's modern data platform. You'll architect reliable pipelines, create

Full-time

USD 118,000.00 - 148,000.00 per year

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization

Analyst, Lead Data Engineering

Skills

Summary

Dice Job Match Score™

Similar Jobs

Analyst, Lead Data Engineering

Job Details

Skills

Summary

Dice Job Match Score™

Similar Jobs