Pyspark jobs in edison, nj

Senior Data Software Engineer/ AWS, Databricks, PySpark

Remote

•

Today

We are looking for a Senior Data Software Engineer to join a team that builds and maintains data infrastructure and platform tooling for a large engineering organization. The work spans cross-region data exchange solutions, Databricks-based data sharing infrastructure, and backend integrations used daily by engineers across multiple regions. Responsibilities Design and implement solutions for cross-region data exchange in environments with strict regulatory and security requirements Build and ma

Full-time

Senior Data Software Engineer/ Databricks, Apache Spark, PySpark

Remote

•

Today

We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark , SQL , and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark , preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices. Responsibilities Design, develop, and maintain scalable data pipelines using Apache S

Full-time

Senior Data Engineer/ Databricks, PySpark, Python

Remote

•

Today

We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including

Full-time

IT Engineer (Python, PySpark, AWS, RestAPI)

Remote

•

7d ago

Systems Engineering Services is seeking a IT Engineer based in the Washington DC area to work on site 3-4 Days a week in the Reston Town Center Area. Top 5 Technical Skills: PythonPysparkRest APIAWSGenerative AI and LLMSQLJob Description: Description: Local candidates preferred, with an expectation to be in RTC 3-5 days per weekExcellent communication and written skillsAbility to work independentlyHands-on Generative AI and LLM expertise, including AI agents, Retrieval-Augmented Generation (RAG)

Easy Apply

Full-time

Depends on Experience

Databricks Senior Data Engineer -Pyspark

New York, New York

•

17d ago

Hiring: Senior Data Engineer Databricks/PySpark Location: New York, NY Onsite Requirements: 7+ years of Data Engineering experience 4+ years hands-on with Databricks & Spark/PySpark Strong Python, SQL, Delta Lake Experience with AWS (S3, Glue) and Google Cloud Platform (BigQuery, GCS) Strong ETL/ELT, Spark optimization & data pipeline development Experience with CI/CD, Git, pytest Excellent communication and technical documentation skills Consulting/project delivery experience

Easy Apply

Contract, Third Party

Depends on Experience

Senior Snowflake Migration Architect / Lead Developer Healthcare

Hybrid in South Brunswick Township, New Jersey

•

9d ago

We are looking for a highly experienced Snowflake Migration Architect / Technical Lead / Senior Developer to lead the migration of large-scale on-premises databases and data warehouse platforms to Snowflake Cloud Data Platform. The ideal candidate must have strong hands-on Snowflake expertise, experience designing and executing complex database/data warehouse migrations, and prior experience working within the Healthcare domain. This is a senior hands-on role requiring the candidate to participa

Easy Apply

Contract

110,000 - 150,000

Palantir AI Engineer (Insurance / Financial Services) !!! NY/NJ/GA (Onsite)

Jersey City, New Jersey

•

24d ago

Position: Palantir AI Engineer (Insurance / Financial Services) Location - Jersey City, NJ & Atlanta, GA (Onsite) Duration: Long Term Exp:- Minimum 6 Years of experience Client: EXL No GC PLEASE SHARE COMPLETE EDUCATION DETAILS, VISA STATUS AND LINKEDIN PROFILE FOR QUICK RESPONSE. Must haves:- Palantir Foundry, Palantir AIP, LLM, RAG/OAG, GenAI, Python, Pyspark, Apache Spark, Kafka Job Description: We are seeking an experienced GenAI Engineer specialized in Palantir Foundry and Palantir Artifi

Easy Apply

Contract

Depends on Experience

Senior Databricks Architect with MS Fabric

Hybrid in New York, New York

•

Yesterday

Mandatory Technologies: MS Fabric, Databricks, PySPark, Azure DevOPS, Databricks Genie, Agent Bricks & Insurance domain exp is preferred and plus. Responsibilities: Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions in MS FabricExperience in enterprise adoption ensures the integration of modern, AI-driven capabilities and aligns architecture with key business outcomesMS Fabric, Databricks Architect to lead the design, architecture, and impleme

Easy Apply

Third Party, Contract

$80

Database Engineer

New York, New York

•

6d ago

A client of Innova Solutions is immediately hiring for a Database Engineer Position type: Full-time Contract (W2) Role: Database Engineer Duration: 4+ months Contract Location : New York, NY Remote role Must have Skills Python, Spark / PySpark, RESTful APIs, API versioning, input validation, pagination, and error standards in Python using FastAPI / Django / Flask, Airflow, Dagster, or similar Primary Skill Required for the Role: 5+ years of experience in Data Engineering or equivalent comb

Easy Apply

Contract

Depends on Experience

Data Engineer

Remote or New York, New York

•

Today

RESPONSIBILITIES: Kforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data pipelines, optimizing distributed data processing workloads, implementing data quality and observability frameworks, and resolving complex performance and production challenges across cloud-based data platforms. REQUIREMENTS: * Str

Contract

$74 - $74 hourly

Data Manager

Lawrence Township, New Jersey

•

Today

ob Title: Data Manager/Data Solutions Engineer ID: 26-05001 Work Location: Princeton Pike (Lawrenceville, NJ 08648) Position Type: 50% onsite Hours: Mon-Fri 8 am-5 pm ROLE SUMMARY The Company's Commercialization Business Insights & Technology (CBI&T) Data and AI (D&A) New Build team is responsible for executing on prioritized work leveraging Databricks as its data foundation platform.Seeking a US Data Lead to manage delivery of these data assets and data products end to end.This position is the

Easy Apply

Contract

80 - 82

AWS Python Developer

Berkeley Heights, New Jersey

•

6d ago

Job Title: AWS Python Developer. Location: Omaha, NE or Berkeley Heights, NJ or Coral Springs, FL or Alpharetta, GA. (5 Days onsite/week) Exp: 12+ Years Mandatory Skills: AWS AI Services, AWS Lambda, Python AI Good to Have Skills: AWS Glue, AWS S3, CI/CD Architecture, SQL & Database testing What you will do Be part of a team designing developing testing and implementing applications for calculating sales channel residual payments and associated reporting analysis and AI driven intelligence funct

Easy Apply

Contract

Depends on Experience

Palantir Engineer / Foundry Engineer

New York, New York

•

24d ago

Role: Palantir Foundry EngineerWe are looking for a strong Palantir Foundry Engineer with hands-on experience building data solutions, applications, and workflows on the Palantir platform. Required Skills: Strong hands-on experience with Palantir Foundry Experience working with Foundry Ontology Objects, Links & Actions Strong Python / SQL / PySpark skills Experience building and maintaining data pipelines in Foundry Hands-on experience with Pipeline Builder / Code Repositories Experience with

Easy Apply

Full-time

$40,000 - $200,000

Lead Software Engineer- Financial Services Data Engineering: Pyspark / Java / BigData / Datalake / AI

Jersey City, New Jersey

•

Today

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer- Financial Service Data Engineering: Pyspark / Java / BigData / Datalake / AI, at JPMorganChase within the Asset and Wealth Management- Analytics & Applied AI Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As

Full-time

USD 156,750.00 - 215,000.00 per year

Data Engineer at a Major Japanese Bank

Hybrid in Jersey City, New Jersey

•

24d ago

Description: Summary: Builds systems that gather, store, and process large volumes of data for analysis. Responsibilities: Develop ETL pipelines, ensure data quality, optimize data storage solutions. Skills: Python, SQL, cloud data tools experience (e.g., AWS Glue, Azure Data Factory). Job Overview: We are seeking an experienced Django Backend Lead Developer to join our team. The ideal candidate will have a strong background in backend development, cloud technologies, and bigdata processing. Thi

Easy Apply

Contract

Senior Data Engineer - Databricks, Rate - $75/hr on C2C, Houston or Berkeley Heights, NJ, Hybrid Project.

Hybrid in Berkeley Heights, New Jersey

•

Today

Job Description: We are looking for an experienced Senior Data Engineer with strong Databricks expertise to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have extensive experience in data processing, data pipeline development, cloud-based data platforms, and big data technologies. Key Responsibilities: Design, develop, and maintain scalable data pipelines using Databricks. Build and optimize ETL/ELT workflows for processing large volumes of structure

Easy Apply

Contract, Third Party

Up to $75

AWS Data Lead

Hybrid in Newark, New Jersey

•

Yesterday

Job Title: AWS Data Pipeline Engineer / Technical Lead /AWS Data Engineer Location: Newark, NJ (Hybrid 2 to 3 days onsite per week), Local candidates Duration: 12 Months Exp Needed - 14+ Years Domain: Investment Banking Position Summary We are seeking a highly experienced AWS Data Pipeline Engineer/Technical Lead to design, build, optimize, and support scalable, enterprise-grade data pipelines within a cloud-native AWS environment. Key Responsibilities Design, develop, deploy, and maintain bat

Easy Apply

Contract, Third Party

55 - 65

Application Programmer

Jersey City, New Jersey

•

3d ago

Application Programmer - Jersey City, NJ - Contract - $68-73 Per HRJoin our team to work on innovative solutions in a hybrid setting, with responsibilities including hands-on application development and support for data, analytics, and reporting functionalities. This contract role requires extensive experience with modern data technologies and collaboration with technical leads and product owners. DescriptionStart ASAP, with expectations to begin 2-4 weeks after offer.Hybrid schedule requiring a

Easy Apply

Contract, Third Party

$68 - $73

Principal Data Scientist - R01568403

Remote or Edison, New Jersey

•

Today

About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction. Brillio ta

Full-time

USD 180,000.00 - 190,000.00 per year

Staff/Senior Data Scientist, Entity Resolution Team

New York, New York

•

Today

The Opportunity This is an exciting time at Enigma. We're on the cusp of releasing our next generation of small business intelligence products built on years of learnings in the space. We are seeking an experienced Data Scientist to join our Entity Resolution team and help shape the trajectory of these products. Your work will directly impact the accuracy, scalability, and predictive capabilities of our data platform, influencing key business decisions for our customers. The Role Data is at th

Full-time

USD 180,000.00 - 270,000.00 per year

Pyspark jobs in Edison, NJ, USA