Lead Data Engineer

  • Houston, TX
  • Posted 1 day ago | Updated 3 hours ago

Overview

Hybrid
$120,000 - $130,000
Full Time

Skills

S3
Athena
Glue
EMR/Spark
ETL
Python
PySpark
Hadoop
Spark
Scala
Snowflake
AWS

Job Details

Hi,

We have urgent requirements for our direct client, please go through the below Job Description. If you are interested please send me your updated word format resume to and reach me @ .

Role: Lead Data Engineer

Location: Houston, TX (3 days onsite, 2 days work from home)

Duration: Full Time

Job Description:

  • Candidate should Provide technical expertise in needs identification, data modelling, data movement, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project perspective. Oversee and govern the expansion of existing data architecture and the optimization of data query performance via best practices. The candidate must be able to work independently and collaboratively
  • 10+ Years of experience as a Data Engineer
  • Strong technical expertise in Spark and Scala is must
  • Strong experience with Python
  • Strong expertise in ETL process and with various data model concepts
  • Knowledge of star schema and a snowflake schema
  • Good to have knowledge on AWS services such as S3, Athena, Glue, EMR/Spark with major emphasis on S3 and Glue
  • Experience with Big Data Tools and technologies

Key Skills:

  • Strong technical expertise in Spark and Scala is must
  • Good Understating of data structures and data analysis using Python

Responsibilities:

  • Understand and translate business needs into data models supporting longterm solutions.
  • Analyze data-related system integration challenges and propose appropriate solutions.
  • Assist with and support setting the data architecture direction (including data movement approach, architecture / technology strategy, and any other data-related considerations to ensure business value).
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.