Overview
On Site
$55 - $57
Contract - W2
Skills
Python
Pyspark
ETL
Job Details
Job Title: Python Developer with pyspark experience
Location: McLean VA
Duration: 6 months
- Develop and optimize ETL pipelines using Python, PySpark, PySpark Notebooks with AWS EMR.
- Should have good understanding of Spark Resilient Distributed Datasets (RDD), Data Frame, and Datasets.
- Work with large-scale datasets and build distributed computing solutions.
- Design and implement data ingestion, transformation, and processing workflows using IICS jobs.
- Write efficient and scalable Python code for data processing.
- Collaborate with data engineers, data scientists, and business teams to deliver insights.
- Optimize performance and cost efficiency for big data solutions.
- Implement best practices for CI/CD, testing, and automation in a cloud environment.
- Monitor job performance, troubleshooting failures, and tuning queries.
With Regards
Kevin Veeraboina,
Area Code: Extn: 104
kiran (at) technocompinc (dot) com
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.