Overview
On Site
Hybrid
Depends on Experience
Contract - W2
Contract - 1 Year(s)
Skills
Apache Spark
Data Modeling
Extract
Transform
Load
IBM DB2
Microsoft SQL Server
Oracle
Python
Reporting
SQL
Scratch
Job Details
Role: Big Data Engineer
Location: NYC(Onsite)
Experience Level: 10+ years
Note: Only on W2
Job Description:
ETL Pipelines using python from scratch ability to independently write efficient and reusable code for ETL Pipelines Expert pipelines expert in OOP Principles and concepts Expert in Data modelling Concepts such as Schemas and entity relationships Expert at Analysing and developing quires in SQL in Various dialects (SQL Server, DB2, Oracle) familiarity with Airflow understands how to develop DAGs Expert in Data ware houses Big Query Data Bricks Delta Lake house and how to programmatically ingest, Cleanse govern and report data out of the familiarity with spark is a plus.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.