Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
Skills
Apache Spark
Erwin
Python
Shell scripting
Hadoop
Cloudera
Hive
Job Details
Sr. Data Engineer Pittsburgh, PA Hybrid (3 day remote 2 day onsite)
W2 Role
Must Have : Apache Spark, Erwin, Python, Shell scripting, Hadoop, Cloudera, Hive
Roles and Responsibilities:
- Design and implement new applications/maintain existing applications/ Support RTB functions
- 4+ years of hands-on experience with Spark 3.
- Strong Python and Shell scripting skills.
- Expertise in Hadoop Cloudera (administration, table management, HDFS file processing).
- Solid understanding of data and system architecture.
- Experience with data modeling (Erwin Tool).
- Familiarity with Alation or similar data mining/reporting tools.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.