Senior Data Engineer PySpark Python

Date Posted: 07/09/2026

Hiring Organization: Rose International

Position Number: 503944

Industry: Financial Services

Job Title: Senior Data Engineer PySpark Python

Job Location: Tampa, FL, USA, 33612

Work Model: Hybrid

Work Model Details: Hybrid -3 days onsite and 2 days remote

Employment Type: Temp to Hire

FT/PT: Full-Time

Estimated Duration (In months): 6

Min Hourly Rate($): 65.00

Max Hourly Rate($): 77.00

Must Have Skills/Attributes: Big Data, Hadoop, PySpark, Python, Spark, SQL

Experience Desired: Experience in data pipelines and applications using Python, PySpark (10 yrs); Expertise in various Big Data platforms (e.g., Hadoop, Hive, Kafka, Spark) (10 yrs); Write complex SQL queries and stored procedures (10 yrs); Develop and enhance ETL (Extract, Transform, Load) (10 yrs)

Required Minimum Education: Bachelor's Degree

Preferred Education: Master's Degree

**C2C is not available**

Job Description
Required Education:
Bachelor's degree/University degree or equivalent experience

Preferred Education
Master's degree preferred

Required Qualifications:
Expert-level proficiency in Python programming, including object-oriented design, data structures, algorithms, and extensive experience with various Python libraries.
Deep expertise in developing, optimizing, and deploying PySpark applications for large-scale data processing, ETL, and real-time analytics on distributed systems (e.g., Spark SQL, Spark Streaming, DataFrames).
Strong understanding of Apache Spark architecture, Hadoop ecosystem, and experience with distributed computing concepts. Familiarity with big data storage formats (e.g., Parquet, ORC).
Solid experience with both relational databases (e.g., Oracle) and NoSQL databases (e.g., MongoDB). Strong SQL writing and optimization skills.
Experience in designing, developing, and consuming RESTful APIs using Python frameworks (e.g., Flask, FastAPI, Django REST Framework).
Strong understanding and practical experience with CI/CD tools (e.g., Jenkins) and containerization technologies (Docker, Kubernetes).
Expert-level proficiency with Git.
Experience with unit testing (e.g., Pytest), integration testing, and performance testing frameworks for Python and PySpark applications.
Exposure to or direct experience with Artificial Intelligence (AI) and Machine Learning (ML) concepts, frameworks (e.g., TensorFlow, PyTorch), or relevant projects is a significant advantage

Preferred Qualifications:
Exposure to at least one major cloud provider (AWS, Azure, or Google Cloud Platform), specifically with their compute, storage, and data services (e.g., S3, ADLS, EMR, Databricks, Azure Synapse) preferred.

Soft Skills:
Exceptional analytical and problem-solving abilities, with a strong capacity to understand complex business needs and translate them into effective technical solutions.
Excellent leadership, team management, and mentoring capabilities.
Superior verbal and written communication skills, with the ability to articulate complex technical concepts clearly to both technical and non-technical audiences.
Strong collaboration and interpersonal skills, with a proven ability to work effectively with cross-functional teams.
Highly proactive, results-oriented, and a strong commitment to delivering high-quality, innovative solutions.
Ability to thrive and lead in an agile, dynamic, and fast-paced work environment.

We are seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic technology team. This role requires an individual with deep expertise in Python, PySpark, Big Data technologies, and SQL, coupled with a strong ability to work independently and contribute significantly to complex data engineering initiatives. The ideal candidate will have a proven track record in designing, developing, and optimizing scalable data solutions, with experience in ETL processes and a keen interest in leveraging the latest technologies. Domain knowledge in Finance will be a significant advantage, enabling the candidate to contribute to critical financial crime compliance projects.

Job Overview:
Design, develop, and implement robust, scalable, and high-performance data pipelines and applications using Python, PySpark, and Big Data technologies.
Work autonomously to analyze requirements, propose technical solutions, and deliver high-quality code and data products, ensuring alignment with architectural standards and business objectives.
Utilize expertise in various Big Data platforms (e.g., Hadoop, Hive, Kafka, Spark) to process, transform, and manage large datasets efficiently.
Write complex SQL queries, stored procedures, and optimize database performance for large-scale data warehousing and analytics solutions.
Develop and enhance ETL (Extract, Transform, Load) processes to ensure data quality, integrity, and timely delivery. Experience with various ETL tools and methodologies is a plus.
Proactively research, evaluate, and integrate new and emerging technologies, frameworks, and tools to improve development processes and solution capabilities.
Ensure adherence to coding standards, conduct thorough code reviews, and implement best practices for software development, data governance, and security.
Diagnose and resolve complex technical issues related to data pipelines, performance bottlenecks, and system integrations in a fast-paced environment.
Collaborate effectively with cross-functional teams including architects, data scientists, business analysts, and QA engineers. Provide technical guidance and mentorship to junior team members.
Identify opportunities to use AI tools to speed up development, code reviews, unit testing and deployment.

#CT1

• **Only those lawfully authorized to work in the designated country associated with the position will be considered.**

• **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.**

Benefits:
For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity:
For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).