Apache Spark Jobs in New Jersey

Refine Results
21 - 40 of 345 Jobs

Data Engineer (Middle) ID35916

Agile Engine

•

Remote

Full-time

What you will do Build and support ETL pipelines;Monitor data pipelines, identify bottlenecks, optimize data processing and storage for performance and cost-effectiveness;Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and business stakeholders;Working with Terraform to build AWS infrastructure;Analyze sources and build Cloud Data Warehouse and Data Lake solution.Must haves 3+ years of professional experience with Python;3+ years of pr
Easy Apply
Posted 5 days ago | Updated 5 days ago

VDOT - Agentic Data Engineer

Cyber Resource Provider LLC

•

Remote or Richmond, Virginia, USA

Full-time, Part-time, Contract, Third Party

Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems The Virginia Department of Transportation's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction bet
Easy Apply
Posted 3 days ago | Updated 9 hours ago

Data and Machine Learning Engineer (E5879)

APN Consulting Inc

•

Piscataway, New Jersey, USA

Full-time

APN Consulting, Inc. is a progressive IT staffing and services company offering innovative business solutions to improve client business outcomes. We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and AI / ML. Due to our globally expanding service offerings we are seeking top-talent to join our teams and grow with us. Direct Client Requirement Position: Data and Machine Learning Engineer Location: Piscataway NJ - Hybrid Schedule (3 days on site, 2 days remote)
Easy Apply
Posted 8 days ago | Updated 7 hours ago

Big Data Architect

Photon

•

Jersey City, New Jersey, USA

Full-time

We are Photon, one of the world's largest Digital Platform Engineering company providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.I found your profile interesting and wanted to chat with you about a role in one of our programs as a 'Big Data Architect'. Please refer the below job description and let me know if you are interested in proceeding. Designation: Big Data ArchitectLocation:
Easy Apply
Posted 52 days ago | Updated 12 days ago

Data Engineer III

Kforce Technology Staffing

•

Remote or Mountain View, California, USA

Contract

RESPONSIBILITIES: Kforce has a client in Mountain View, CA that is seeking a Data Engineer . Responsibilities: * Developing/refactoring/optimizing real time data processing applications using apache Flink * Developing/refactoring/optimizing batch data processing applications using apache spark * Migration of real time data pipelines to isolated kafka infrastructure and coordinate migration efforts with consumers * Operational monitoring and on-call support for business critical applications *
Posted 9 days ago | Updated 5 hours ago

Data Engineer

Raas Infotek LLC

•

Remote

Contract

Position: Data Engineer Type: W2 Contract We re looking for a Data Engineer to design, build, and optimize data pipelines that support enterprise analytics and digital transformation initiatives. This role is ideal for someone who thrives in a fast-paced, data-driven environment and has a strong background in modern data engineering tools and cloud platforms.Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using modern data frameworks Collaborate with data analysts, ar
Easy Apply
Posted 1 day ago

Sr. Lead Data Engineer/Architect

iTech US, Inc.

•

Remote

Contract

Having 10+ years of experience as a Data Engineer , Experience in Financial IndustryStrong experience in one of language: Snowflake,Java, Scala, Python, C#Strong experience with: HDFS, YARN, Hive, Spark, Kafka, (AWS), Docker / Kubernetes, Snowflake.Good working Knowledge in Data mining/programming tools (e.g. SAS, SQL, R, Python)5+ years of experience in Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)Experience in Amazon Web Services : VPC, S3, CloudFront, EC2, Lambda
Easy Apply
Posted 3 days ago | Updated 2 days ago

Data Architect

Xyant Services, Inc.

•

Jersey City, New Jersey, USA

Contract

Title - Data Architect with MS Fabric Location - Hybrid (New Jersey, NJ) Contract Job Description: Minimum 5+ years experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Data Bricks etc. Azure experience is preferred over other cloud platforms.Minimum 12 + years of proven experience with SQL, schema design and dimensional data modelling.Solid knowledge of data warehouse best practices, development standards and methodologies.Experience wit
Easy Apply
Posted 1 day ago

Data Engineer (Middle/Senior) ID34675

Agile Engine

•

Remote

Full-time

What you will do Collaborate with engineers, architects, data scientists, analytics teams, and business stakeholders in an Agile setup;Build, and support both Cloud and On-Premise enterprise data infrastructure;Design and implement robust, reusable, and scalable data pipelines to automate ingestion, processing, and delivery of both batch and streaming data (structured and unstructured);Develop data APIs and delivery services to support critical business processes, analytical models, and ML appli
Easy Apply
Posted 26 days ago

Palantir Data Integration Engineer

CogniSoft Technologies

•

Remote

Contract

Job Title: Palantir Data Integration EngineerLocations: 100% REMOTE Job Description:A Palantir Data Integration Engineer is responsible for designing, developing, and maintaining data integration solutions using Palantir's software platform. In this role, you will work closely with stakeholders to develop scalable data pipelines, build robust applications, and integrate various data sources to drive impactful decision-making. You ll contribute to the full software development lifecycle, from req
Easy Apply
Posted 29 days ago

Hadoop Developer

Innova Solutions, Inc

•

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for a Hadoop Developer. Position type: Contract Duration: Long Term Location: Chicago, IL/Jersey City, NJ/Dallas, TX (Hybrid) As a Hadoop Developer, you will: Position Summary: Top 3 Skills: 1. Hands-on experience of Hadoop ecosystem and its tools 2. Proficient in Spark and at least one programming language(Python/Scala) 3. Good Communication and teamwork skills Required Education: A Bachelors and/or Masters Degree in Relevant field Other Required Skills:
Easy Apply
Posted 60+ days ago | Updated 10 days ago

Senior Data Engineer

Precision System Design Inc.

•

Remote or Cleveland, Ohio, USA

Contract

Are you an experienced Data Engineer looking for a change? Do you want to work with cutting edge technology for an established Fortune 100 company on a fully remote basis? Our client is looking for a Data Engineer to help develop, maintain, and enhance the capabilities of their data platform. You'd build out data pipelines to support data science models to enable automated data processing and increased efficiency. You'd also help support packaging and deploying models to production, and developi
Easy Apply
Posted 19 days ago | Updated 1 hour ago

Integration Engineer

PeopleNTech

•

Woodbridge Township, New Jersey, USA

Contract, Third Party

Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.Design, develop, and deploy Spark program in data bricks environment to process and analyse large volumes of data.Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.Proficient in developing programs in Python and SQLExperience with Data warehouse Dimensional data modelling.Working with even
Easy Apply
Posted 18 days ago

AWS Databricks Architect

Chabez Tech LLC

•

Remote

Contract

Position: AWS Databricks Architect Location: Remote Job Description: We are seeking a highly experienced AWS Databricks Architect to lead the architecture and design of scalable data solutions within the AWS cloud ecosystem for ThermoFisher. The ideal candidate will bring deep expertise in cloud-native data processing, analytics, and architecture, along with strong leadership capabilities to drive large-scale projects. Responsibilities:Design and implement end-to-end cloud data architectures us
Easy Apply
Posted 4 days ago

Data Engineer (W2 Only)

Ohm Systems, Inc

•

Remote

Contract

About the Role: We are seeking an experienced Data Engineer to join our Supply Chain Optimization team within the AIML (Artificial Intelligence & Machine Learning) division.This role is ideal for someone with a strong background in software engineering who is passionate about using data to drive operational excellence in supply chain processes.Minimum Qualifications 5+ years of experience in a software engineering or data engineering role.Proficiency in Python for data processing and automation.
Easy Apply
Posted 1 day ago

Databricks Architect

P2PSoftTek Inc

•

Remote

Contract

Looking for 15 plus years of overall experience Need Financial Domain Experience Responsibilities Design, implement, and deploy data platforms at scale in both public and private clouds Guide clients in establishing their data strategy, including data governance, data architecture, and data quality management Educate clients on modern technologies, architectures, and approaches for data & analytics Drive discovery phases, understand business problems, and propose technical solutions to address t
Easy Apply
Posted 8 days ago

Senior Data Engineer

Metasys Technologies

•

Remote or Las Vegas, Nevada, USA

Contract

Senior Data Engineer Las Vegas, NV (onsite) 6+ Months Project (Contract to Perm) Our prestigious $1B revenue per year client is seeking Senior Data Engineers to join their cutting-edge team, driving forward-thinking technology solutions for the future. This opportunity has the potential to convert into a salaried role. The Senior Data Engineer is responsible for designing, building, and managing the data platform and tools to allow for the efficient processing and analysis of large data sets. D
Easy Apply
Posted 60+ days ago | Updated 7 hours ago

Software Database Engineer

Kforce Technology Staffing

•

Remote or Redmond, Washington, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a Software Database Engineer in Redmond, WA. Summary: We are looking for a Software Database Engineer to join their Data Pipeline team. As a member of the team, you will get to live on the front edge of modern technology by building on things like Azure Synapse Analytics and Azure Data Explorer while building ETLs and process in Databricks and Data Factory. You will help build state of the art pipelines and data models that are at the heart
Posted 1 day ago | Updated 5 hours ago

Lead Cloud Solutions Designer

Motion Recruitment Partners, LLC

•

Woodbridge Township, New Jersey, USA

Full-time

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Lead Cloud Solutions Designer in Iselin, NJ or Charlotte, NC (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a h
Easy Apply
Posted 2 days ago | Updated 8 hours ago

Solution Architect - Nvidia AI

eGrove Systems Corporation

•

Remote

Contract

Solution Architect - Nvidia AI 100% remote looking for a Solution Architect that specializes in NVidia technology. The right candidate will be able to effectively assess client environments and needs to then work with engineers and infrastructure teams to implement NVidia and AI/ML technologies. They will be helping to build out CDW's AI/ML consulting team for their clients. They will oversee the projects and engineering execution on projects, from conception to execution. Top Candidate :- Dee
Easy Apply
Posted 4 days ago