Apply Now

Senior PySpark Developer / Engineer

Hybrid in Dallas, TX, US • Posted 2 days ago • Updated 2 days ago

Full Time

No Travel Required

Hybrid

Depends on Experience

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

PySpark
SQL
UNIX
Workflow
Shell Scripting
Scripting

Summary

Role: Senior PySpark Developer / Engineer

Location: Dallas, TX (3 Days onsite/ week)

Full Time Position

Job Description:

Must-Have Technical Skills: PySpark, SQL and UNIX

PySpark Expertise-

Strong hands-on experience with PySpark architecture understanding

Clear understanding of how PySpark jobs execute in the background

Ability to read, write, analyze, and enhance PySpark scripts and configurations

SQL Proficiency:

Strong SQL skills

Experience working with SQL as part of data processing and PySpark job execution

Unix Shell Scripting:

Should have good understanding of Unix shell scripting.

Ability to understand backend Unix scripts supporting PySpark workflows

Experience in reading, analyzing, writing, and modifying shell scripts for PySpark integration

ETL Knowledge:

Hands-on experience with ETL processes using any programming language or framework

Ability to understand and work with complementary ETL workflows alongside PySpark

Job Scheduling & Automation

Experience with at least one enterprise scheduling/automation tool such as: Autosys/ Control‑M/ Airflow/ or similar tools used in production environments

Nice-to-Have Skills

Experience working with finance domain applications

Familiarity with related frameworks or tools that enhance PySpark-based workflows

''The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. ''

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10214351
Position Id: 8952361
Posted 2 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Irving, Texas

•

Today

The Python and PySpark Developer is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team.. Responsibilities: Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business n

Full-time

USD 107,120.00 - 160,680.00 per year

Big DATA Developer with Python

Irving, Texas

•

4d ago

About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 9

Full-time

$83,912 - $128,080

Fulltime -Data Engineer -Pyspark /Spark/Python-Need local to Dallas, TX

Hybrid in Irving, Texas

•

30+d ago

Pyspark / Python /Spark /Data Engineer /Hadoop Fulltime -Local to Dallas ,TX Experience in Hadoop/big data technologies. Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr) Hands-on experience with Python/Pyspark. Experience in spark programming.

Easy Apply

Full-time

$80,000 - $100,000

PySpark Developer

Irving, Texas

•

Today

Location: Irving, TX Salary: $100,000.00 USD Annually - $130,000.00 USD Annually Description: Our client is currently seeking a PySpark Developer PySpark Developer with 5-10 years experience in data engineering practice. Responsible for designing, developing and maintaining scalable data pipelines, optimizing data workflows and ensuring the integrity and availability of data for business intelligence Roles & Responsibilities Onsite role with strong experience in Apache Spark framework incl

Contract

USD 100,000.00 - 130,000.00 per year

Search all similar jobs

Senior PySpark Developer / Engineer

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs