PySpark Developer

Irving, TX, US • Posted 2 hours ago • Updated 2 hours ago
Full Time
On-site
$100,000 - $120,000/yr
Fitment

Dice Job Match Score™

👤 Reviewing your profile...

Job Details

Skills

  • PySpark Developer

Summary

PySpark Developer
Location :
Irving, TX (Local Only)
Full Time Only

Must Have Technical/Functional Skills
PySpark Developer with 5-10 years experience in data engineering practice. Responsible for designing, developing and maintaining scalable data pipelines, optimizing data workflows and ensuring the integrity and availability of data for business intelligence
Roles & Responsibilities
Onsite role with strong experience in Apache Spark framework including good understanding of core concepts, performance optimization and industry best practices.
Proficient in PySpark with hands-on coding experience and ability to implement complex business level transformations.
Collaborate with the stakeholders and analysts to understand data requirement and deliver robust, creative and innovative solutions.
Familiarity with unit testing, object-oriented programming (OOPS) concepts and interpreting test results.
Proficient to write complex and efficient SQL queries to extract the business critical insights from large-scale data.
Experience with scheduling of the transformation jobs as per business requirement.
Perform root-cause analysis and troubleshoot errors on data pipelines, evaluating data quality issues, and implementing corrective fixes

Salman Shaikh

Quadrant Technologies +1- (Cell)


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91085293
  • Position Id: 8931769
  • Posted 2 hours ago
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Irving, Texas

Today

Contract

USD 120,000.00 - 130,000.00 per year

Irving, Texas

Today

Contract

USD 100,000.00 - 130,000.00 per year

Irving, Texas

2d ago

Full-time

$83,912 - $128,080

Dallas, Texas

Today

Easy Apply

Full-time

Depends on Experience

Search all similar jobs