Lead Data Engineer

Lead Data Engineer

Looking for local candidates to Houston, TX

The Lead Data Engineer plays a pivotal role in conceptualizing, designing, and implementing data foundations and end-to-end solutions, including data platforms for the Shell Business. This role is instrumental in fostering a data-driven culture within the organization, extending beyond IT teams to the broader business community. The Lead Data Engineer is expected to be a subject matter expert, a thought leader in the organization's data strategy, and the key driver in defining the Vision and Data Strategy for robust and future-ready IT solutions.

Responsibilities

• Lead the conceptualization and design of data foundations and end-to-end solutions, including data platforms.
• Act as a visible community leader for data engineers, fostering a culture of data-driven decision-making.
• Conduct quality, community, and conference presentations/trainings to share knowledge and best practices.
• Drive change and improvement through a deep understanding of the inter-relationship between People, Process, Data, and Technology.
• Coordinate the change management process, incident management, and problem management process.
• Drive implementation efficiency and effectiveness across pilots and future projects to minimize cost, increase speed of implementation, and maximize value delivery.
• Contribute to community building initiatives like Centers of Excellence (CoE) and Communities of Practice (CoP).
• Ensure the central data repository is crucial for the PDS Vision 2030.
• Enhance accessibility, boost productivity, and facilitate better collaboration through the Products Data Exchange (PDE).
• Enable comprehensive data harmonization and cleansing to ensure data consistency, accuracy, and reliability.
• Support the achievement of the PDS 2030 Vision by centralizing data management.

Requirements

• Mastery in AWS/Azure/SAP.
• Expertise in ELT, Data Modeling, Data Integration & Ingestion, Data Manipulation, and Processing.
• Skilled in GITHUB, Action, Azure DevOps, Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, and PyTest.
• A skilled communicator capable of speaking to both technical developers and business managers.

• Experience in project management and running a scrum team.
• Experience working with BPC, Planning.
• Exposure to working with external technical ecosystem.
• Managing small teams.
• MKDocs documentation.
• Portfolio: Shell IDT/Downstream & Renewables IDT/Trading & Supply/TS - Crude & Products/TS - Products/TS - Products Investments Program: Project: Products Data Exchange.