Lead Data Engineer

Houston, TX, US • Posted 15 hours ago • Updated 15 hours ago

Full Time

On-site

$140000 - $160000/yr

INSPYR Solutions

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

DATA ENGINEER
PYTHON
PANDAS
NUMPY
PYTEST
SQL
DBT
AIRBYTE
DATA LAKE
DELTA LAKE
AWS
S3
EC2
SNOWFLAKE

Summary

Title: Lead Data Engineer
Location: Houston, TX 77002 (ONSITE)
Duration: Direct Hire
Work Requirements: , Holders or Authorized to Work in the U.S.

Job Description
We are currently seeking an experienced Lead Data Engineer to join the Big Data and Advanced Analytics department. The Lead Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for the midstream oil and gas operations, engineering, and measurements business units.

Responsibilities

Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse
Design and implement data quality pipelines to ensure data correctness and building trusted datasets
Design and implement a Data Lakehouse solution which accurately reflects business operations
Assist with data platform performance tuning and physical data model support including partitioning and compaction
Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives
Automate and optimize the data lifecycle, find insights from raw data, and applying DevOps principle to data pipelines
Work with business leaders to deliver custom software solutions meeting data needs
Build and support a data platform for data engineering teams to build, deploy and manage applications

Qualifications

8+ years of experience as a Data Engineer designing and maintaining data pipeline architectures
5+ years of in-depth programming experience in Python and SQL
5+ years in software development lifecycle experience with software engineering, development, testing, version control, refactoring, and deployment
Experience with common Python Data Engineering packages including Pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3
Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake
Experience with data platform architecture responsible for high-level design, strategy and implementation of data infrastructure, including data modelling, designing scalable architectures and ensuring data governance, security and compliance
Knowledgeable of modern data platform technologies including Apache Airflow, Kubernetes, and S3 Object Storage
Experience with AWS, Snowflake, DBT and Airbyte is preferred
Experience with infrastructure as code, building consistent and repeatable cloud infrastructure

About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients'' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10228513
Position Id: 26-155865
Posted 15 hours ago

Company Info

About INSPYR Solutions

As a leading expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients’ business objectives and cultural needs. Our tailored offerings include a wide variety of professional services, project solutions, managed services, and talent resources, all bolstered by our strategic partnerships with cutting-edge technology services. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities.

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Lead Data Engineer

Los Angeles, California

•

Yesterday

Role: Lead Data Engineer Location: Remote (U.S. preferred) Compensation: ~$150K base (flexible for the right candidate) Type: Full-time or Contract-to-HireThe OpportunityWe are seeking a Lead Data Engineer to play a critical role in designing and building a next-generation data platform. This is a highly impactful, hands-on leadership role focused on modernizing data architecture using Databricks, PySpark, and a Lakehouse approach. You will work closely with both technical teams and business sta

Easy Apply

Contract, Third Party

$120000 - $150000

Lead Offensive Security Engineer

Hybrid in Deerfield Beach, Florida

•

28d ago

Title: Lead Offensive Security Engineer Location: Deerfield Beach, FL(3/2 Hybrid) Duration: Direct Hire Compensation: $130,000 - 140,000 Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Lead Offensive Security Engineer We are seeking a highly skilled Lead Offensive Security Engineer to drive our organization''s proactive security strategy. This role will be responsible for leading offensive security operations, including vulnerability management, threat hunting, thre

Easy Apply

Full-time

Depends on Experience

Lead Software Engineer - Azure Machine Learning

Remote

•

14d ago

Lead Software Engineer - Azure Machine Learning Flexible Hybrid Work Schedule in Baltimore, MD Responsibilities: Strong experience w/ Kafka, Python, React, Kubernetes and PostgresAbility to work with SRE to ensure containers are set up correctlyDesign, develop, and maintain software solutions for forecasting and optimizing distributed energy resource loads to increase market participation revenues.Collaborate with data scientists and analysts to create predictive models and algorithms.Implement

Easy Apply

Full-time

$150000 - $180000

Zuora Data Engineer

Remote

•

Yesterday

Title: Zuora Data Analyst Location: Remote Duration: 6+ month contract Compensation: $80.00 90.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Zuora Data Analyst Position Summary We are seeking a Senior Finance Data Analyst to lead the automation and advancement of our Net Renewal Forecasting capabilities. This role sits at the intersection of Finance, Billing (Zuora), and Data Engineering, and will play a critical role in transforming a manual, Excel-driven

Easy Apply

Full-time, Third Party, Contract

$80 - $90

Search all similar jobs