Texas State Library and Archives Commision

Apply Now

Python Developer

Charlotte, NC, US • Posted 4 hours ago • Updated 4 hours ago

Full Time

On-site

Fitment

Dice Job Match Score™

🛠️ Calibrating flux capacitors...

Job Details

Skills

Database
Analytics
Business Operations
Data Extraction
Data Quality
Regulatory Compliance
Testing
Workflow
Performance Tuning
Data Engineering
Software Development
PySpark
Python
Apache Spark
SQL
RDBMS
Extract
Transform
Load
Orchestration
Job Scheduling
CA Workload Automation AE
Problem Solving
Conflict Resolution
Attention To Detail
Communication
Collaboration
Financial Services
Cloud Computing
Big Data

Summary

Job Description:

Our Client is seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic data engineering team. This role is ideal for a motivated professional with a strong background in big data technologies, ETL processes, and database systems. The successful candidate will play a key role in designing, developing, and optimizing data pipelines and analytics solutions that support critical business operations.

Key Responsibilities:

Design, develop, and maintain scalable data pipelines using PySpark and Spark SQL.
Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver robust solutions.
Optimize and troubleshoot complex ETL workflows and data transformation processes.
Write efficient SQL queries for data extraction, transformation, and loading.
Ensure data quality, integrity, and compliance with enterprise standards.
Participate in code reviews, testing, and deployment activities.
Monitor and maintain production workflows, including job scheduling and performance tuning.

Required Skills & Qualifications:

5+ years of experience in data engineering or software development.
Strong proficiency in PySpark, Python, and Spark SQL.
Solid experience with SQL and relational database systems.
Proven expertise in ETL development and data pipeline orchestration.
Familiarity with job scheduling tools; Autosys experience is a plus.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration abilities.

Preferred Qualifications:

Experience working in the financial services industry.
Familiarity with cloud platforms and big data ecosystems

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 80183517
Position Id: 27fd1f0e9a1e3528d7ec498d9dce8af9
Posted 4 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Data Engineer

Charlotte, North Carolina

•

Today

This is a hands-on role for someone whos comfortable designing and delivering modern data solutions while influencing how we use data across the company. Required Skills:5+ years experience in data engineering or a similar role.Strong experience with SQL, Python, and cloud-based platforms like AWS, Google Cloud Platform, or Azure.Solid understanding of data modelling, pipelines and orchestration tools (Airflow, dbt, or similar).Familiarity with modern data ecosystems e.g. Spark, Databricks, Sno

Easy Apply

Contract

45 - 50

Senior Data Engineer

Remote

•

Today

Who we are Samsara (NYSE: IOT) is the pioneer of the Connected Operations Cloud, which is a platform that enables organizations that depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At Samsara, we are helping improve the safety, efficiency and sustainability of the physical operations that power our global economy. Representing more than 40% of global GDP, these industries are the infrastructure of our planet, i

Full-time

USD 119,595.00 - 201,000.00 per year

Data Pipeline Engineer (Databricks + AWS Glue)

Remote

•

4d ago

Location: United States (Remote / Hybrid)Job Type: Full-TimeExperience: 510 Years About the RoleWe are seeking a highly skilled Data Pipeline Engineer with expertise in Databricks, AWS Glue, PySpark, Python, SQL, MongoDB, and AWS to build scalable, cloud-native data platforms. You will be responsible for designing, developing, and optimizing high-performance ETL pipelines that process large volumes of structured and semi-structured data for analytics, reporting, and enterprise applications. This

Easy Apply

Full-time

Depends on Experience

Senior Data Engineer II

Remote

•

Today

Full-time

USD 134,470.00 - 203,400.00 per year

Search all similar jobs

More jobs at Texas State Library and Archives Commision in Charlotte, NC