Python PySpark Engineer

Innova Solutions has a client that is immediately hiring for a Python PySpark Engineer.

Title: Python PySpark Engineer (With Azure Fabric experience)

Job type: Fulltime/Contract on W2

Location: Charlotte NC Hybrid (3 days in-office/2 days remote)

Duration: 12 Months with possibility of extension

As a Python PySpark Engineer, you will:

• Design, develop, and optimize ETL pipelines using PYSPARK, S3 and Dremio
• Working on ProfitView Modernization which requires Pyspark, Python, Dremio, ETL, Financial exp.
• Work with large-scale structured and unstructured data from various sources.
• Implement data ingestion, transformation, and loading processes into data lakes and data warehouses.
• Collaborate with BI developers, data analysts, and business stakeholders to understand data requirements.
• Ensure data quality, integrity, and governance across all data pipelines.
• Monitor and troubleshoot performance issues.
• Participate in code reviews, testing, and deployment processes.
• Document technical solutions, data flows, and architecture.

An ideal candidate should have:

• Hands-on experience with PySpark for data processing and transformation.
• ETL tools Informatica, Oracle PL/SQL , Teradata
• Experience in enterprise frameworks, UNIX script writing
• Experience in job scheduling, batch process, data analysis, defect resolution
• Understanding of Data Warehousing concepts (e.g., star/snowflake schema, slowly changing dimensions).
• Experience with cloud platforms (Azure, or Google Cloud Platform) and services like S3
• SQL skills for data extraction, transformation, and analysis.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Excellent problem-solving and communication skills.
• Agile/Scrum knowledge is a plus
• Headspace experience Preferred
• Fabric experience

Qualified candidates should APPLY NOW for immediate consideration! Please hit APPLY to provide the required information, and we will be back in touch as soon as possible.
We are currently interviewing to fill this and other similar positions. If this role is not a fit for you, we do offer a referral bonus program for referrals that we successfully place with our clients, subject to program guidelines. ASK ME HOW.
Thank you!
Chinmai Rath Email: Contact: PAY RANGE AND BENEFITS: Pay Range*: Between $60-$65 per hour

*Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc.

Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).

ABOUT INNOVA SOLUTIONS: Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centers across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields.

Recent Recognitions:

• Named One of America s Best Employers for New Grads by Forbes (2024)
• Named One of the Best Companies to Work For by U.S. News & World Report (Private Companies List, 2024-2025)
• One of the Largest IT Staffing Firms in the US Ranked #3 by Staffing Industry Analysts (SIA, 2024)
• One of the Largest Staffing Firms in the US Ranked #13 by Staffing Industry Analysts (SIA, 2024; includes Innova Solutions, Volt, & HireGenics)
• Named One of the Top Ten Private Companies in Atlanta by the Atlanta Business Chronicle (2023)
• One of the Largest Certified Minority Business Enterprises (MBEs) in the United States (NMSDC, 2024)
• AWS Advanced Tier Services Partner with 100+ certifications

Website:

Innova Solutions offers a referral bonus for qualified Ambassadors who refer eligible referrals. Submit referrals at and earn $250-$1,000 per referral.

Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at or . Please indicate the specifics of the assistance needed. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities. Innova Solutions (HireGenics/Volt) does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. 1324b.

The company will consider for employment qualified applicants with arrest and conviction records in a manner that complies with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, and other applicable laws.