Overview
On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 1 Month(s)
Skills
Agile
Amazon Web Services
Apache Parquet
Apache Spark
Cloud Computing
Communication
Continuous Delivery
Continuous Integration
Job Details
We are looking for Pyspark Developer for our client in New York City, NY
Job Title: Pyspark Developer
Job Type: Contract
Job Description:
Pay Range: $55hr - $60hr
- Must have skills : PySpark.
- Good to have skills : AWS.
- Grade(s) : B2.
- Location(s) : Dallas /NYC.
- In-depth knowledge of Pyspark, DataFrames, Datasets, RDDs, Spark Streaming and Parquet partitioning concepts.
- Experience with Data bricks and AWS S2, AWS Athena, AWS Glue. Should have understanding for AWS Athena.
- This role requires strong skills in Python, PySpark, SQL, and experience with data warehousing and ETL/ELT processes. Senior developers also need to be proficient in cloud technologies and have experience with data governance and security.
- Data Python (must avoid Application Python).
- Strong experience with SQL.
- Knowledge of version control (Git), CI/CD tools, and Agile methodologies.
- Excellent communication.
- Should have the ability to train and lead the developers within the team, for any of the above skill gap.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.