Overview
On Site
BASED ON EXPERIENCE
Full Time
Skills
Management
Use Cases
Analytical Skill
Innovation
Data-flow Diagrams
Specification Gathering
Design Patterns
Storage
Analytics
Collaboration
Data Warehouse
Migration
Data Architecture
Roadmaps
Scalability
Mentorship
SQL
Dimensional Modeling
Data Modeling
Amazon Web Services
Microsoft Azure
Google Cloud
Google Cloud Platform
Data Integration
Extract
Transform
Load
ELT
Streaming
Change Data Capture
Python
Data Engineering
Pandas
NumPy
scikit-learn
Terraform
Cloud Computing
Software Development
Unit Testing
Code Refactoring
Continuous Integration
Continuous Delivery
Version Control
Snow Flake Schema
Apache HTTP Server
Communication
SANS
FOCUS
Professional Services
Genetics
Law
Job Details
Title: Lead Data Engineer
Location: Houston, TX 77002 (ONSITE)
Duration: Direct Hire
Work Requirements: , Holders or Authorized to Work in the U.S.
Job Description:
Seeking a Lead Data Engineer that will architect, design, and implement a cloud based modern enterprise data platform to support data analytic use cases for the midstream oil and gas business units. This individual will lead the development of enterprise-wide data strategies enabling advanced analytical uses case and driving innovation through modern cloud technologies.
Responsibilities include:
- Architect, design, and implement comprehensive cloud-based data architectures
- Develop data models, data flow diagrams, and technical specifications for complex data ecosystem
- Create reference architectures and design patterns for data ingestion, processing, storage, and analytics
- Lead cross-functional teams in the design and implementation of data products
- Collaborate with data engineers, analysts, data scientists, and stakeholders to translate business requirements into technical solutions
- Provide technical guidance on cloud data services including data lakes, data warehouses, and streaming platforms
- Create and implement strategies for migrating on-premise data platforms to cloud environments
- Develop and implement long-term data architecture roadmaps aligned with business objectives
- Define and implement data integration strategies across multiple systems and platforms
- Implement complex modules and core services of the data platform ensuring correctness, reliability, scalability, and stability
- Mentor junior data engineers in design and code reviews and implementation best practices
The successful candidate will meet the following qualifications:
- 7+ years of experience as a hands-on Data Engineer designing and implementing enterprise-wide data platform architectures
- Expert level experience in Python and SQL
- Expert level experience in dimensional modeling, data vault methodology, and modern data modeling techniques
- Deep expertise in at least one major cloud provider (AWS, Azure, Google Cloud Platform) with knowledge of their data services
- Experience in various data integration patterns including ETL, ELT, Pub/Sub, Streaming, and Change Data Capture
- Experience with common Python Data Engineering packages including Pandas, NumPy, Pyarrow PyTest, Scikit-Learn, and Boto3
- Experience with Infrastructure as Code principals and tools such as Terraform and Cloud Formation
- Experience in software development practices such as Design Principles and Patterns, Modularity, Unit Testing, Refactoring, CI/CD, and version control
- Experience building data products leveraging Snowflake, DBT, and Airflow
- Experience in implementing Data Lakehouse patterns using Apache Iceberg or Delta Lake
- Excellent communication skills with ability to present complex technical concepts to non-technical stakeholders
About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.