PySpark jobs in North Carolina

Senior Data Software Engineer/ AWS, Databricks, PySpark

Remote

•

Today

We are looking for a Senior Data Software Engineer to join a team that builds and maintains data infrastructure and platform tooling for a large engineering organization. The work spans cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used daily by engineers across multiple regions. Responsibilities Design and implement solutions for cross-region data exchange in environments with strict regulatory and security requirements Build and ma

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

W2 Only (No C2C) :: Hybrid :: Senior Data Analyst / Engineer / Archinect with Strong Databricks, Power BI, PySpark & LeanIX Exp. || G.C / U.S.C

Hybrid in Charlotte, North Carolina

•

Today

Senior Data Analyst / Engineer / Archinect with Strong Databricks, Power BI, PySpark & LeanIX Exp. || G.C / U.S.C 6+Months Hybrid W2 Only (No C2C) Position Summary: Join our Architecture Enablement team to build and operate enterprise architecture governance analytics. You will own data analysis and data quality for the LeanIX Data Lake, translate reporting needs into scalable datasets, and deliver insights through SQL, Databricks, and Power BI. This role bridges data engineering, governance,

Easy Apply

Contract

Depends on Experience

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

IT Engineer (Python, PySpark, AWS, RestAPI)

Remote

•

7d ago

Systems Engineering Services is seeking a IT Engineer based in the Washington DC area to work on site 3-4 Days a week in the Reston Town Center Area. Top 5 Technical Skills: PythonPysparkRest APIAWSGenerative AI and LLMSQLJob Description: Description: Local candidates preferred, with an expectation to be in RTC 3-5 days per weekExcellent communication and written skillsAbility to work independentlyHands-on Generative AI and LLM expertise, including AI agents, Retrieval-Augmented Generation (RAG)

Easy Apply

Full-time

Depends on Experience

Data Engineer Role

Remote

•

11d ago

Role- Data Engineer Location- New York Job Description We are seeking an experienced Data Engineerto join our team and build robust, scalable data pipelines. In this role, you will: Design and implement scalable PySpark data pipelines for batch and streaming workloads Optimize Spark jobs and queries for performance and cost efficiency Build and maintain ETL/ELT processes following data engineering best practices Troubleshoot and resolve complex data pipeline and processing issues Collaborate wi

Easy Apply

Full-time

Depends on Experience

Data Engineering Career Opportunity

Remote

•

28d ago

Hi, Are you looking to start a career in Data Engineering, transition from another IT role, or strengthen your existing data skills? Explore a structured, industry-focused Data Engineering careerdesigned around the technologies and skills commonly used in modern cloud data environments. What Youll Explore Programming & Databases Python programming Advanced SQL Data structures and data processing concepts Relational databases and query optimization Cloud & Data Platforms Microsoft Azure

Easy Apply

Full-time, Third Party

Depends on Experience

Databricks Engineer

Remote

•

7d ago

Employment Type: W2 Only Desired Skills Experience with the Databricks Lakehouse Platform Strong knowledge of Apache Spark, PySpark, Python, SQL, or Scala Experience developing and optimizing data pipelines Knowledge of Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows Experience with data warehousing, data lakes, ETL, and ELT processes Understanding of data governance, security, access controls, and platform administration Experience integrating Databricks with AWS, M

Easy Apply

Full-time, Third Party

$70 - $80

Data Architect

Remote

•

7d ago

About the Company Blackstraw.ai is an end-to-end technology services company specializing in Artificial Intelligence (AI) and Engineering solutions across Data Science, Data Engineering, LLM/GenAI and LLMOps. Founded in 2018, we help global enterprises across North America, Europe and Asia to build and operationalize AI systems that create measurable business impact. Our mission is to make AI adoption simpler, faster and scalable through a blend of deep domain expertise, reusable accelerators an

Easy Apply

Full-time

Depends on Experience

Databricks Consultant ---- 12+ year experience required

Remote

•

16d ago

Need W2 independent candidate'sJob Overview: Seeking an experienced Databricks Consultant with 12+ years of data engineering and analytics experience. The ideal candidate will have strong expertise in Databricks, SQL, Apache Spark, and modern data platforms, with experience designing and implementing scalable data solutions.Key Skills:12+ years of IT/Data Engineering experienceStrong hands-on experience with Databricks, Spark & SQLExpertise in PySpark and data pipeline developmentExperience with

Easy Apply

Contract

Depends on Experience

Sr. Python/Django Developer

Hybrid in Charlotte, North Carolina

•

9d ago

Responsibilities: Participate in the development of backend micro services using Django. Design and implement scalable and secure APIs. Integrate Azure Cloud services for application deployment and management. Utilize Azure Databricks for big data processing and analytics. Implement data processing pipelines using PySpark. Collaborate with front-end developers, product managers, and other stakeholders to deliver comprehensive solutions. Conduct code reviews and ensure adherence to best practices

Easy Apply

Contract

Depends on Experience

Enterprise Data Architect

Remote

•

8d ago

Title: EnterpriseData Architect with DatabricksLocation: RemoteDuration: 6+ MonthsThe client is seeking a strong Data Architect to be part of their data product development team. It consists of data engineers who can assist in translating business requirements into data products. Create efficient, reusable data pipelines; work with product owners and stakeholders to design, develop, and implement data supply chains in enterprise data warehouse environments using Microsoft Azure, ADF, Python, Pys

Easy Apply

Contract, Third Party

Depends on Experience

Databricks Architect

Remote

•

Yesterday

Required Skills & Experience Current, hands-on development experience is essential. This role requires the ability to read, write, debug, and lead code reviews of production PySpark and SQL codenot just architectural oversight. Candidates must demonstrate recent (within past 12 months) hands-on development work including debugging live code, explaining business logic and technical implementation, optimizing queries, and implementing data pipelines. Ability to comprehend and explain unfamiliar c

Easy Apply

Contract

Depends on Experience

Databricks Technical Lead/Architect

Remote

•

21d ago

Hi, Hope youre doing well!! Please find the requirement below. If you find yourself comfortable with the requirement please reply back with your updated resume or call me back at Position:Databricks Technical Lead/Architect Location:Remote Duration: 6+ Months Visa: Client won't be able to sponsor any visa LinkedIN ID MUST BE ABLE TO TAKE A GLIDER Key Responsibilities Technical Leadership: Establish architectural patterns and best practices for medallion architecture, Delta Lake

Easy Apply

Third Party, Contract

Depends on Experience

Palantir Foundry Engineer/Architect

Remote or Hybrid in Livermore, California

•

Today

About GSPANN Headquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high-technology, and manufacturing, we help our clients to transform and deliver business value by optimizing their IT capabilities, practices, and operations. Counting on our ten offices, including four global delivery centers, and approximately 1400 employees globally, we offer the intimacy of a

Easy Apply

Third Party, Contract

Depends on Experience

Databricks Engineer

Remote

•

8d ago

Over 8 Years of experience in IT. Design and implement end-to-end lifecycle of Databricks platform on AWS.Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.Expertise in AWSImplement data access controls, Lineage and auditing using Unity catalog.Implement CI/CD pipelines between different environments.Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource managem

Easy Apply

Contract

Depends on Experience

Senior Databricks Engineer

Remote

•

Yesterday

Position: Senior Databricks Data Engineer Location: Remote / Hybrid Duration: Long Term Responsibilities Develop scalable data pipelines using Databricks, PySpark and SQL.Build and maintain Delta Lake tables using the Medallion Architecture.Develop batch and real-time data processing pipelines.Implement data ingestion using Auto Loader, APIs, Kafka or cloud storage.Optimize Spark jobs, SQL queries and Delta tables.Implement data governance and security using Unity Catalog.Develop Databricks Work

Easy Apply

Third Party, Contract

Depends on Experience

Senior Data Scientist

Remote

•

2d ago

Job Title: Senior Data Scientist Location: Remote Role & Responsibilities Overview: Develop machine learning models for various P&C insurance products related to pricing, customer behavior, retention, price sensitivity, risk segmentation, etc.Build, enhance, and maintain GLM-based pricing models (frequency, severity, pure premium) for insurance productsPerform model comparison and benchmarking between traditional actuarial models and ML approachesDesign and implement feature engineering pipelin

Easy Apply

Full-time

Depends on Experience

Lead Data Engineer

Cary, North Carolina

•

17d ago

Lead Data Engineer Cary, NC (On-site / Hybrid) Data Platform Architecture & Engineering Own the end-to-end lakehouse architecture: Bronze / Silver / Gold layer contracts, zone layout on ADLS Gen2, Delta Lake table design, partitioning, schema evolution, and retention strategy. Design and build metadata-driven, parameterized ingestion frameworks that onboard new data sources without bespoke pipeline code for every feed. Write canonical PySpark and Scala Spark transformation jobs that serve as t

Easy Apply

Full-time

120000 - 130000

Databricks Architect

Charlotte, North Carolina

•

30+d ago

Note: This role requires you to travel across USA (Ideally 15 days/month) About the Role: We are seeking an experienced Databricks Architect to design, develop, and optimize scalable data engineering solutions on the Databricks Lakehouse platform. This role focuses on leveraging hands-on expertise in Unity Catalog, Apache Spark, PySpark, SQL, and Delta Lake to build robust data pipelines while ensuring industry-leading data governance, security, and access control standards across cloud environ

Easy Apply

Full-time

60 - 75

PySpark jobs in North Carolina, USA