Bigdata Lead

Overview

On Site
BASED ON EXPERIENCE
Contract - W2
Contract - Independent

Skills

Big data
Data Lake
Leadership
Data
Microsoft Azure
Python
Apache Spark
Transformation
Scala
PY
ADF
Analytics
SQL
PySpark
Tidal
Health care

Job Details

Position : Big Data Lead / Data Engineer
Location : Philadelphia, PA (Remote) EST Prefer
Duration : Contract

JOB DESCRIPTION :
Primary Skill :

1 Azure data bricks- Build Data Pipelines using ADB-Leveraging Python and Spark
Build Data Transformation in ADB
Convert Scala Pgms to Py Spark Pgms
Understand the SCALA program in Data Bricks
2 ADF
Secondary Skills
1 Azure data lake gen 2
2. Synapse analytics (dedicated SQL pool)
3. Exp in delta Lake
4. Pyspark
Nice to Have : Tidal Scheduler , Exp in Healthcare Domain