Apply Now

Big Data Pyspark Developer || Fulltime || Irving, TX & Tampa, FL(Hybrid)

Irving, TX, US • Posted 1 day ago • Updated 1 day ago

Full Time

On-site

Fitment

Dice Job Match Score™

🎯 Assessing qualifications...

Job Details

Skills

python
Apache Spark
SparkSQL
Python for DATA
Big Data Hadoop Ecosystem

Summary

Job Title: Big data Pyspark Developer
Work Location : Irving, TX & Tampa, FL
Mode: Fulltime

Job Summary

Exp 6 Years Must have good technical experience and should be able to provide technical solutions for multiple modules in parallel on need basis and bring the task to closure on time
Unix SQL and Shell Scripting experience is a must have
Expertise in Designing and developing scalable Apache spark ETL based Data processing pipelines
Strong commandline knowledge in UnixLinux with Shell scripting using Bash Kornshell or Perl and File processing using awk scripts
Expertise in SQL querying and complex joins
Implementing comprehensive Spark based Data validation frameworks transforming large volumes of Financial data within the Project lifecycle
Expertise with complex Data workflows with Apache AirFlow managing task dependencies SLAs etc to ensure timely data delivery and corresponding automated validation controls
Strong Analytical skills and expertise on SparkSQL for Data analysis and validation ensuring the delivery of clean queryready datasets for business consumption
Expertise in Data quality checks and monitoring
Quality Engineering team where 70percent of effort will be for developing automation frameworks for testing Remaining 30percent effort will be on manual testing until its fully automated
Handson with Automation Framework Design for ETL and API
SME in Data Analysis Database testing Messaging queues
Experience with coding standards code reviews source management build processes CICD pipeline

Mandatory Skills : Apache Spark, Big Data Hadoop Ecosystem, Python, Python for DATA, SparkSQL

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 90943872
Position Id: 2026-42869
Posted 1 day ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Sr Big Data PySpark- Full time

Hybrid in Irving, Texas

•

3d ago

About LTIMindtree LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by n

Easy Apply

Full-time

$83,912 - $128,080

Python Developer- Full Time Role

Hybrid in Irving, Texas

•

4d ago

Job Title:Senior Python Developer Work Location: Irving TX (Hybrid) Duration: Full Time Role Job Description: Seeking a Senior Python Data Engineer with 7 years of experience skilled in Apache Spark and Python to design and implement scalable data processing solutionsDevelop and maintain robust data pipelines using Apache Spark and PythonCollaborate with data scientists and analysts to optimize data workflowsEnsure data quality and integrity across large datasets Implement data transformations

Easy Apply

Full-time

Depends on Experience

Big Data Developer- Full Time

Hybrid in Irving, Texas

•

16d ago

Title - Big Data Developer Location - Tampa, FL/ Irving, TX (Hybrid) Duration - Fulltime (Permanent) Must Have Mandatory Skills:AWS Cloud Architecture, Big Data Hadoop Ecosystem.Good to Have:Apache Spark, AWS Code Pipeline, Data Architecture, Python.A good professional with 8 to 10 years of experience in Bigdata PySpark.Must AWS EKS and Data engineering Pyspark, Scala.Good knowledge of AWS and Snowflake.Good understanding of CICD and system design.Candidate with prior experience working on tech

Easy Apply

Full-time

Depends on Experience

Sr Java Spark Developer- combination is must- Full time

Hybrid in Irving, Texas

•

3d ago

Easy Apply

Full-time

$83,912 - $128,080

Search all similar jobs