PYSPARK ENGINEER

Pyspark, Spark, Azure, Cloud
Contract W2, Contract Corp-To-Corp, 6 Months
Depends on Experience
Travel not required

Job Description

PYSPARK ENGINEER – DATA ENGINEER- ONSITE CHARLOTTE NC 
We are hiring Pyspark Engineers to join our ongoing project at our client location in North Carolina.- Onsite presence needed. Contract Long term H1B/CITIZENS Required Skills:
Expertise in Spark - Event/stream processing - Managing high event volumes, reconciliation, exception management
Expertise in Spark - Batch Processing
Experience with Azure/AWS Data services (Azure preferred)
Experience working in an Agile set-up
Roles and Responsibilities
Design and Build the Metadata Driven Ingestion
Coordination with the Technical team in developing the solution
Work with Business stakeholders to understand the requirement
Unit Testing, System Testing and support during UAT
Should be a good team player; also demonstrate good analytical and problem solving skills;
Commitment to excellence in designing, coding, testing, documenting and till delivering project
Knowledge on financial/banking
Requirements
Overall 4-8 years of IT experience
Minimum 3years of working knowledge in Python and Pyspark implementation
Experience working in DWH concepts
Good to have Technical background in Linux & Java skills
Code versioning tools such as GIT , Azure CI/CD
Experience building metadata driven framework for File Ingestion
Familiar with various design and architectural patterns
Dice Id : 91089021
Position Id : 7415582
Originally Posted : 3 months ago
Have a Job? Post it