Lead AWS Data Engineer

Hybrid in Houston, TX, US • Posted 2 hours ago • Updated 2 hours ago

Full Time

Hybrid

$150000 - $200000/yr

INSPYR Solutions

Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

AWS
S3
EC2
LAMBDA
GLUE
CLOUDWATCH
IAM
DATA ENGINEER
PYTHON
PYSPARK
DATA LAKE
ETL
ELT
TERRAFORM
CLOUDFORMATION
DATA MODELING

Summary

Title: Lead Data Engineer (AWS Lakehouse)
Location: Dallas, TX or Houston, TX (hybrid)
Duration: Direct Hire
Work Requirements: , Holders or Authorized to Work in the U.S.

Job Description:
We’re hiring a hands-on Lead Data Engineer to help modernize an enterprise data platform from legacy, on-prem systems to a cloud-native AWS lakehouse. This is a lead individual contributor role with high ownership and a strong hands-on focus (approximately 70%), balancing deep technical delivery with design guidance, code reviews, and mentorship.

While we leverage AWS S3 Tables (managed Apache Iceberg), success in this role requires a solid understanding of how modern table formats operate under the hood, beyond reliance on fully managed tooling.

This position will offer flexibility for hybrid work schedules to include both in-office presence and telecommute/virtual work, to be based from either Houston or Dallas, TX.

Key Responsibilities:

Design, build, and operate end-to-end, production-grade data pipelines in AWS
Re-engineer legacy ETL into a lakehouse architecture (Bronze/Silver/Gold) on S3
Work hands-on with open table formats in AWS (S3 Tables / Apache Iceberg) and understand their metadata, snapshots, schema evolution, and performance characteristics
Develop pipelines using Python, PySpark, and Spark on AWS Glue and/or EMR
Orchestrate workloads using Airflow or AWS Step Functions
Partner with data architects to translate business requirements into data products
Perform code reviews, mentor engineers, and contribute hands-on in production
Support agile development practices, including planning, demos, and reviews

Qualifications

Minimum Requirements:

BA/BS in Computer Science, Engineering, or a related field plus at least 8 years of hands-on data engineering experience, or demonstrated equivalent experience and education
Strong, current hands-on experience with AWS data services, including S3 and Spark-based processing
Hands-on experience with an open table format (such as Apache Iceberg, Delta Lake, or Hudi), with a clear understanding of table metadata, schema evolution, partitioning, and performance tradeoffs
Proficiency in Python and PySpark for production data pipelines
Experience designing, building, and operating data pipelines end-to-end in AWS
Experience orchestrating data pipelines using Airflow or AWS Step Functions
Strong communication skills and ability to operate as a hands-on technical lead

Preferred Qualifications:

Master's degree in a relevant field
Experience working with AWS S3 Tables or native Apache Iceberg in AWS environments
Experience modernizing on-prem or legacy data warehouse platforms
Familiarity with lakehouse performance tuning, schema evolution, and partitioning
Experience with data pipeline orchestration frameworks
Exposure to AI/ML data readiness or downstream analytics use cases
Experience working in large, complex enterprise environments

Why You’ll Love Working Here:

Leadership Impact: Shape the direction of our enterprise data platform and mentor the next generation of data engineers
Enterprise Reach: Work with diverse, large-scale datasets from critical business systems.
Modern Tech Stack: AWS-first environment with continuous improvement and best-practice adoption.
Career Growth: Opportunities to advance into architecture or senior leadership roles.

About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10228513
Position Id: 26-00621
Posted 2 hours ago

Company Info

About INSPYR Solutions

As a leading technology solutions company, we connect top IT talent with clients to provide innovative business solutions through our IT Staffing, Professional Services, and Infrastructure Solutions divisions. There are four elements that set us apart and serve as pillars of our company philosophy: Quality, Expertise, People, and Relationships. By always striving for excellence in these areas and focusing on the human aspect of our business, we work seamlessly together with our talent and clients to match the right solutions to the right opportunities.

Twitter

Facebook

Instagram

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.