Hybrid: Sr. Data Engineer

  • Jersey City, NJ
  • Posted 5 hours ago | Updated 5 hours ago

Overview

Hybrid
Depends on Experience
Full Time

Skills

ETL
Spark
Hadoop
Python
GCP

Job Details

One of our client is seeking a Sr. Data Engineer to join our team in Jersey City, NJ (Need Onsite day 1, hybrid 3 days from office).

Job Description:

We are seeking a highly skilled Data Engineer having experience with ETL, Spark hadoop and Funds background.

Responsibilities:

  • Analysing data sets, designing, and coding stable and scalable data ingestion workflows also integrating into existing workflows
  • Working with team members and stakeholders to clarify requirements and provide the appropriate ETL solution.
  • Hands-on experience for various data sourcing in Hadoop also Google Cloud Platform.
  • Ensuring new code is tested both at unit level and system level design develop and peer review new code and functionality.
  • Operate as a team member of an agile scrum team.
  • Root cause analysis skills to identify bugs and issues for failures.
  • Support Prod support and release management teams in their tasks.
Requirements:
  • ETL, spark hadoop as tech skills but needs someone from Funds background.
  • Proficient in Hadoop, Python, Spark, SQL Unix and Hive
  • Basic understanding of on Prem and Google Cloud Platform data security
  • Hands on development experience on large ETL/ big data systems .Google Cloud Platform being a big plus
  • Hands on experience on cloud build, artifact registry ,cloud DNS ,cloud load balancing etc.
  • Hands on experience on Data flow, Cloud composer, Cloud storage ,Data proc etc.
  • Basic understanding of data quality dimensions like Consistency, Completeness, Accuracy, Lineage etc.
Preferred, but not required:
  • Experience with Google Cloud Platform.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.