Pyspark Developer - Onsite - Atlanta, GA/Mason, OH/Richmond, VA/Norfolk, VA/Walling ford, CT

  • Atlanta, GA
  • Posted 13 days ago | Updated 12 days ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)

Skills

PySpark
AWS
Scala
Spark
Python
postgresql

Job Details

Title : Pyspark Developer
Location : Onsite (Chicago, IL)
Duration : Long Term
Relevant Experience : 12+Years

Must Have Skills

Skill 1 8 Yrs of Exp Strong Hands-on in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.

Skill 2 8 Yrs of Exp PySpark Developer

Skill 3 8 Yrs of Exp Scala, Spark or Python.

Skill 4 8 Yrs of Exp -AWS cloud and AWS DocuDB

Skill 5 8 Yrs of Exp big data processing tools

Skill 6 5 Yrs of Exp Kafka topics and K-SQL

Skill 7 5 Yrs of Exp No SQL databases like Mongo DB.

Skill 8 5 Yrs of Exp -Agile Methodology/JIRA/Confluence.

Overall 9+ years of IT Development experience 5+ years of experience as a PySpark Developer or a related role (Mandatory) Good experience in AWS (Mandatory), AWS Glue, Hudi & Kafka Experience in working with AWS cloud, PostGreSQL and AWS DocuDB Familiarity with big data processing tools and techniques Experience with streaming data platforms Excellent exposure with both relational and non-relation Databases Experience in Nifi will be a plus Excellent analytical and problem-solving skills

Roles & Responsibilities:

  • Client is looking for a Strong developer who has
  • Strong Hands-on in AWS cloud in S3/ATHENA/GLUE/EMR/VPC.
  • Creating and Managing Data Pipelines and Stream sets in KAFKA5+ yrs of Proven experience as a PySpark Developer or a related role Strong programming skills in Scala, Spark or Python
  • Experience in working with AWS cloud and AWS DocuDB
  • Familiarity with big data processing tools and techniques Experience with streaming data platforms
  • Excellent analytical and problem-solving skill strong knowledge in Kafka topics and K-SQL
  • Extensive Unix/FTP/ File
  • Handling Strong Hands-on in No SQL databases like Mongo DB Experience with Agile Methodology/JIRA/Confluence Hands-on in Handling all Processors.

Responsibilities:

  • Extensive knowledge in understanding Data and creating Data Pipelines.
  • Interact with Business to understand the requirement of a daily evolving need and adapt to the needs.
  • Handle streaming data platforms. Able to handle all the database storage and retrieval mechanisms for the Mongo DB on and extensive experience in handling.
  • Able to understand the business requirements, tech stack involved and guide the team towards Integral solution approach.
  • Provide extensive development support to the Team in achieving the Project Milestones.
  • Dedicated and committed approach with excellent communication skills.

Regards

Tejaswini