PySpark jobs in Fort Mill, SC

W2 Only (No C2C) :: Hybrid :: Senior Data Analyst / Engineer / Archinect with Strong Databricks, Power BI, PySpark & LeanIX Exp. || G.C / U.S.C

Hybrid in Charlotte, North Carolina

•

Today

Senior Data Analyst / Engineer / Archinect with Strong Databricks, Power BI, PySpark & LeanIX Exp. || G.C / U.S.C 6+Months Hybrid W2 Only (No C2C) Position Summary: Join our Architecture Enablement team to build and operate enterprise architecture governance analytics. You will own data analysis and data quality for the LeanIX Data Lake, translate reporting needs into scalable datasets, and deliver insights through SQL, Databricks, and Power BI. This role bridges data engineering, governance,

Easy Apply

Contract

Depends on Experience

Senior Data Software Engineer/ AWS, Databricks, PySpark

Remote

•

Today

We are looking for a Senior Data Software Engineer to join a team that builds and maintains data infrastructure and platform tooling for a large engineering organization. The work spans cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used daily by engineers across multiple regions. Responsibilities Design and implement solutions for cross-region data exchange in environments with strict regulatory and security requirements Build and ma

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

IT Engineer (Python, PySpark, AWS, RestAPI)

Remote

•

7d ago

Systems Engineering Services is seeking a IT Engineer based in the Washington DC area to work on site 3-4 Days a week in the Reston Town Center Area. Top 5 Technical Skills: PythonPysparkRest APIAWSGenerative AI and LLMSQLJob Description: Description: Local candidates preferred, with an expectation to be in RTC 3-5 days per weekExcellent communication and written skillsAbility to work independentlyHands-on Generative AI and LLM expertise, including AI agents, Retrieval-Augmented Generation (RAG)

Easy Apply

Full-time

Depends on Experience

Sr. Python/Django Developer

Hybrid in Charlotte, North Carolina

•

9d ago

Responsibilities: Participate in the development of backend micro services using Django. Design and implement scalable and secure APIs. Integrate Azure Cloud services for application deployment and management. Utilize Azure Databricks for big data processing and analytics. Implement data processing pipelines using PySpark. Collaborate with front-end developers, product managers, and other stakeholders to deliver comprehensive solutions. Conduct code reviews and ensure adherence to best practices

Easy Apply

Contract

Depends on Experience

Databricks Architect

Charlotte, North Carolina

•

30+d ago

Note: This role requires you to travel across USA (Ideally 15 days/month) About the Role: We are seeking an experienced Databricks Architect to design, develop, and optimize scalable data engineering solutions on the Databricks Lakehouse platform. This role focuses on leveraging hands-on expertise in Unity Catalog, Apache Spark, PySpark, SQL, and Delta Lake to build robust data pipelines while ensuring industry-leading data governance, security, and access control standards across cloud environ

Easy Apply

Full-time

60 - 75

Lead Data Engineer with Databricks

Charlotte, North Carolina

•

Today

Job Description Lead Data Engineer with Databricks Location: Hybrid Charlotte, NC Roles & ResponsibilitiesDevelop high-quality, scalable ETL/ELT pipelines using Databricks technologies including Delta Lake, Auto Loader etc.,Excellent programming and debugging skills in PythonStrong hands-on experience with PySpark to build efficient data transformation and validation logicMust be proficient in at least one cloud platform: AWS, Google Cloud Platform, or AzureNeed someone with Insurance domain

Easy Apply

Third Party, Contract

Depends on Experience

Data Engineer

Charlotte, North Carolina

•

10d ago

Data Engineer - Charlotte, NC; Jersey City, NJ; India- Contract - $54-64 Per HRDescriptionJoin our team as a Data Engineer, supporting the design and development of a strategic data platform. This role is hybrid, based in Charlotte, NC; Jersey City, NJ; or India. As a contractor, you will work on a strategic data platform project, utilizing cloud technologies. Responsibilities include establishing a reference data system and contributing to the data strategy team. Experience with cloud services,

Easy Apply

Contract, Third Party

$54 - $64

Principal Data Engineer / Data Architect – AWS & Google Cloud Platform

Charlotte, North Carolina

•

9d ago

Job OverviewWe are seeking highly experienced Lead Data Engineers, Principal Data Engineers, and Data Architects with 15+ years of experience designing, developing, and implementing enterprise-scale data engineering solutions across AWS and Google Cloud Platform (Google Cloud Platform). The ideal candidate will have extensive experience in cloud data architecture, large-scale data processing, distributed computing, data pipeline development, and technical leadership. We offer H-1B transfer spons

Easy Apply

Contract

Depends on Experience

Associate, eSupport/Development Engineer

Charlotte, North Carolina

•

Today

SMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 employees worldwide in nearly 40 countries. Sumitomo Mitsui Financial Group, Inc. (SMFG) is the holding company of SMBC Group, which is one of the three largest banking groups in Japan. SMFG's shares trade on the Tokyo,

Full-time

USD 97,000.00 - 154,000.00 per year

Senior Data Engineer - Oracle, Spark & Cloud Analytics

Charlotte, North Carolina

•

14d ago

Summary: We are seeking an experienced Senior Data Engineer with deep expertise in Oracle-based analytical platforms and Apache Spark to support large-scale data modernization, migration, and analytics initiatives. The ideal candidate will have hands-on experience building high-performance data pipelines, optimizing large-scale data processing workloads, and integrating enterprise data platforms with modern cloud analytics solutions. Key Responsibilities: Design, develop, and optimize large-scal

Full-time

Senior Full Stack Developer (Python/Backend)

Charlotte, North Carolina

•

Today

Full-time

Full Stack Developer, Associate - (Python/Backend)

Charlotte, North Carolina

•

Today

Full-time

AI Engineer

Fort Mill, South Carolina

•

Today

Job#: 3046287 Job Description: AI Engineer Location: 100% Remote Role Overview As an AI Software Engineer, you will be responsible for designing, developing, and deploying Decision Intelligence and AI-enabled products. These solutions impact patient care, team member and patient experience, and clinical operations. You will work on a product team with engineers, data scientists, and product managers, contributing to the full product lifecycle from ideation to iteration. Key Responsibilities

Easy Apply

Full-time

$75 - $85 per hour

AI Engineer

Fort Mill, South Carolina

•

Today

Job#: 3046323 Job Description: AI Engineer Location: Remote, but cannot sit in California, Illinois, New York or New Jersey Employment Type: Contract to Perm Role Overview As an AI Software Engineer, you will be responsible for designing, developing, and deploying Decision Intelligence and AI-enabled products. These solutions impact patient care, team member and patient experience, and clinical operations. You will work on a product team with engineers, data scientists, and product managers

Easy Apply

Full-time

$75 - $85 per hour

Senior Software Engineer

Fort Mill, South Carolina

•

Today

Where Ambition Meets Innovation Build a career that matches your initiative with an environment centered on innovation, collaboration, and impact. At LPL Financial, you'll work with modern technology, supportive teammates, and the opportunity to contribute to solutions that help clients pursue their financial goals. Job Overview As a Senior Full-Stack Software Engineer, you will contribute to the design, delivery, and support of modern, cloud-native platforms that enable LPL's business and cl

Full-time

USD 106,100.00 - 176,900.00 per year

2027 Early Careers: Analyst, Data Office: Data Engineering - United States, Multiple Locations

Charlotte, North Carolina

•

14d ago

AIG is reimagining the way we help customers manage risk. Join us as an Analyst in the Data Office department to play your part in that transformation with opportunities to learn and grow your skills and experience as a valued member of the team. About Us At AIG, helping organizations and people discover new potential is our purpose. As a global risk leader, we do this for our clients every day. Through our deep expertise in their industries and our innovative solutions that help them smartly

Full-time

USD 86,200.00 - 103,500.00 per year

Data Engineer Role

Remote

•

11d ago

Role- Data Engineer Location- New York Job Description We are seeking an experienced Data Engineerto join our team and build robust, scalable data pipelines. In this role, you will: Design and implement scalable PySpark data pipelines for batch and streaming workloads Optimize Spark jobs and queries for performance and cost efficiency Build and maintain ETL/ELT processes following data engineering best practices Troubleshoot and resolve complex data pipeline and processing issues Collaborate wi

Easy Apply

Full-time

Depends on Experience

Data Engineering Career Opportunity

Remote

•

28d ago

Hi, Are you looking to start a career in Data Engineering, transition from another IT role, or strengthen your existing data skills? Explore a structured, industry-focused Data Engineering careerdesigned around the technologies and skills commonly used in modern cloud data environments. What Youll Explore Programming & Databases Python programming Advanced SQL Data structures and data processing concepts Relational databases and query optimization Cloud & Data Platforms Microsoft Azure

Easy Apply

Full-time, Third Party

Depends on Experience

PySpark jobs in Fort Mill, SC, USA