Overview
On Site
$80 - $90
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)
Skills
ETL Data Engineer
PySpark
Python
SQL
Airflow
Oozie
Tidal
Hadoop
Hive
Greenplum
Data Warehouse
DWH
Data Modeling
Dimensional Modeling
Big Data
SQLAlchemy
psycopg2
BI
Analytics
Job Details
Title: Senior Software Engineer - ETL Developer (Python/Pyspark)
Location: Skillman, NJ (Three days onsite is must)
JD:
Must have Skills:
- 10+ years of experience in designing and developing ETL pipelines leveraging pyspark/python.
- Experience on python database libraries like SQLAlchemy, psycopg2 .etc
- Strong understanding of data warehousing methodologies, ETL processing and dimensional data modeling.
- Advanced SQL capabilities are required. Knowledge of database design techniques and experience working with extremely large data volumes is a plus.
- Demonstrated experience and ability to work with business users to gather requirements and manage scope.
- Experience in workflow tools such as oozie or Airflow or Tidal
- Experience working in a big data environment with technologies such as Greenplum, Hadoop and HIVE
- BA, BS, MS, PhD in Computer Science, Engineering or related technology field
Desirable Skills:
- Experience with large database and DW Implementation (20+ TBs)
- Understanding of VLDB performance aspects, such as table partitioning, sharding, table distribution and optimization techniques
- Knowledge of reporting tools such as Qlik Sense, Tableau, Cognos
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.