Overview
Skills
Job Details
Title : Pyspark Developer
Location : Onsite (Chicago, IL)
Duration : Long Term
Relevant Experience : 12+Years
Must Have Skills
Skill 1 8 Yrs of Exp Strong Hands-on in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.
Skill 2 8 Yrs of Exp PySpark Developer
Skill 3 8 Yrs of Exp Scala, Spark or Python.
Skill 4 8 Yrs of Exp -AWS cloud and AWS DocuDB
Skill 5 8 Yrs of Exp big data processing tools
Skill 6 5 Yrs of Exp Kafka topics and K-SQL
Skill 7 5 Yrs of Exp No SQL databases like Mongo DB.
Skill 8 5 Yrs of Exp -Agile Methodology/JIRA/Confluence.
Overall 9+ years of IT Development experience 5+ years of experience as a PySpark Developer or a related role (Mandatory) Good experience in AWS (Mandatory), AWS Glue, Hudi & Kafka Experience in working with AWS cloud, PostGreSQL and AWS DocuDB Familiarity with big data processing tools and techniques Experience with streaming data platforms Excellent exposure with both relational and non-relation Databases Experience in Nifi will be a plus Excellent analytical and problem-solving skills
Roles & Responsibilities:
- Client is looking for a Strong developer who has
- Strong Hands-on in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.
- Creating and Managing Data Pipelines and Stream sets in KAFKA5+ yrs of Proven experience as a PySpark Developer or a related role Strong programming skills in Scala, Spark or Python
- Experience in working with AWS cloud and AWS DocuDB
- Familiarity with big data processing tools and techniques Experience with streaming data platforms
- Excellent analytical and problem-solving skill strong knowledge in Kafka topics and K-SQL
- Extensive Unix/FTP/ File
- Handling Strong Hands-on in No SQL databases like Mongo DB Experience with Agile Methodology/JIRA/Confluence Hands-on in Handling all Processors.
Responsibilities:
- Extensive knowledge in understanding Data and creating Data Pipelines.
- Interact with Business to understand the requirement of a daily evolving need and adapt to the needs.
- Handle streaming data platforms. Able to handle all the database storage and retrieval mechanisms for the Mongo DB on and extensive experience in handling.
- Able to understand the business requirements, tech stack involved and guide the team towards Integral solution approach.
- Provide extensive development support to the Team in achieving the Project Milestones.
- Dedicated and committed approach with excellent communication skills.
Regards
Tejaswini