Contract Python Data Engineer (Databricks / PySpark / SQL)

Columbus, IN, US • Posted 11 hours ago • Updated 10 hours ago

Contract Corp To Corp

On-site

Fitment

Dice Job Match Score™

⏳ Almost there, hang tight...

Job Details

Skills

sql
python
Pyspark
Databricks

Summary

Job Title: Contract Python Data Engineer (Databricks / PySpark / SQL)
Location: Columbus, IN

Role Summary:

We are seeking a senior-level contract Python engineer with strong experience in Databricks-based data platforms to support and optimize large-scale analytical and data processing workflows. The role focuses on Python performance optimization, PySpark development, and SQL-based analytics in a distributed environment.

The ideal candidate is hands-on, performance-focused, and comfortable working with complex, memory-intensive pipelines.

Key Responsibilities:

Develop and optimize Python-based data processing pipelines on Databricks
Work extensively with PySpark DataFrames, pandas, and SQL
Design and optimize Databricks jobs, notebooks, and workflows
Perform runtime and memory profiling of Python and Spark workloads
Identify and resolve:
Memory retention issues
Inefficient transformations
Performance bottlenecks in large datasets
Optimize pandas PySpark SQL data flows
Support long-running batch and analytical jobs
Collaborate with data scientists and engineers to improve scalability and stability

Required Skills (Must-Have):

Expert Python
pandas, NumPy
Writing memory-efficient, production-quality code
Strong Databricks experience
Notebooks, Jobs, Clusters
Understanding Spark execution and memory behavior
PySpark
DataFrame APIs
Caching, persistence, partitioning
SQL
Complex joins, aggregations, window functions
Performance optimization
Runtime profiling
Memory analysis and debugging
Experience handling large-scale analytical datasets

Nice-to-Have Skills:

Distributed computing frameworks (Spark internals, Ray, multiprocessing)
Experience with cloud data platforms
Familiarity with Python garbage collection and object lifecycle
Experience supporting analytics, reporting, or reliability systems

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 10106248
Position Id: 2026-3786
Posted 11 hours ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Contract Python Data Engineer (Databricks / PySpark / SQL)

Dice Job Match Score™

Job Details

Skills

Summary

Similar Jobs