Apache Spark Jobs in New York

Refine Results
1 - 20 of 506 Jobs

spark developer

Rivi Consulting Group

•

New York, New York, USA

Contract

Responsibilities will include: Understand and implement tactical or strategic solution for a given business problem Discussion with stakeholders on business needs and technology requirements. Define and derive the strategic solutions as well as identify tactical solutions when necessary. Write technical design & other solution documents per Agile (SCRUM) standards. Perform data analysis to aid development work and other business needs. Perform unit testing of the developed code leveraging
Easy Apply
Posted 60+ days ago | Updated 17 days ago

Senior Java Spark Developer

ASK IT Solutions LLC

•

New York, New York, USA

Contract

Job Title: Senior Spark Developer Java Location: 750 Seventh Ave. New York NY 10019 (HYBRID 3 days on site) Local only Duration: 12 Months Contract (with possible extension) SPARK JAVA and SQL Spark: Good concepts of spark core. How a spark process executes and able to solve and write spark code to questions. Java : They should be able to provide solution and write code as well. Hands on Job Description: The ideal candidate will have extensive experience in Java development, a strong understa
Easy Apply
Posted 6 days ago | Updated 8 hours ago

Sr Data Engineer - Big Data, Spark

Photon

•

Jersey City, New Jersey, USA

Full-time

Hi, Hope you are doing well, Myself Mankar from Photon and I have a position with our direct client, please send me your updated resume if you are interested and you can connect me through Sr Data Engineer Jersey City, NJ - Onsite Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyse data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delive
Easy Apply
Posted 21 days ago | Updated 4 days ago

Spark Core expert with Java Development

SANS

•

New York, New York, USA

Full-time

Corp to corp accepted Must be 3+ years of Spark Core and Spark SQL as a Java programmer Please only candidates local to New York City or New Jersey as there is in-perosn interview SPARK CORE SPARK CORE SPARK CORE experts only processing HUGE AMOUNT of data. Market Risk Technology is seeking a strong senior application developer with experience in developing distributed systems, capable of processing very high volumes of data. The ideal candidate will have extensive experience in Java development
Easy Apply
Posted 28 days ago

Sr. Core Java Developer w/d Strong spark experience in Jersey City, NJ - Full time

TecHobbit

•

Jersey City, New Jersey, USA

Full-time

Job Title: Sr. Core Java Developer w/d Strong spark experience Location: Jersey City, NJ Hybrid Role Duration: Full Time Must have: Banking Domain exp. Job Description: Client is looking for Java resource with strong understanding experience of Spark is required for this position.Proficient in Java programming, with experience in Spring, Spring Boot, and REST services to develop robust backend solutions and integrate with distributed systems.Strong expertise in Big Data technologies, including
Easy Apply
Posted 25 days ago

Sr. Data Engineer (Healthcare, Spark, Scala) - Remote

ConsultNet, LLC

•

Remote

Full-time

Title: Sr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structured St
Easy Apply
Posted 10 days ago | Updated 2 hours ago

Senior java developer with Spark - VP - TAMPA

Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi
Posted 60+ days ago | Updated 3 hours ago

Sr. Scala Developer (need real time exp candidate hands on Scala Coder PLZ NO DA)

SumasEdge Corporation

•

New York, New York, USA

Contract, Third Party

Position: Sr. Scala Developer Location: NYC, NY (hybrid) Duration : 12+ Months Experience with APACHE SPARK with SCALA programming ? Experience with APACHE SPARK Actions, Transformations and task Execution hierarchy ?Experience in developing, optimizing, and scaling Spark FunctionsExperience with SCALA framework ? Experience with Functional ProgrammingExperience with Predefined FunctionsExperience with MONADSExperience with TraitsExperience with Case ClassesExperience with Higher Order Functio
Easy Apply
Posted 7 days ago | Updated 3 hours ago

Data Engineer - Need 9+ yrs Candidate - NY/NJ/FL

Photon

•

Weehawken Township, New Jersey, USA

Full-time

Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big Data Analyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment with business requirements. Work with the stakeholders to understand and gather requirements and produce business specifications Validate solution implem
Easy Apply
Posted 17 days ago

Bigdata Solution Architect - FTE - Photon - Onsite role - Jersey City, NJ

Photon

•

Jersey City, New Jersey, USA

Full-time

Key Responsibilities: Lead data and AI/ML initiatives tailored to investment banking or equity markets, aligning with business goals. Architect, implement, and optimize end-to-end AI/ML solutions designed for large-scale datasets, ensuring scalability and efficiency. Leverage AI techniques for data mapping and transformation, enabling seamless integration, unification, and enrichment of complex and heterogeneous datasets across diverse systems and platforms. Drive cross-functional collaborati
Easy Apply
Posted 28 days ago | Updated 14 days ago

Azure Data Engineer (12+ yrs Exp Only) with Finance Experience || Hybrid || New Jersey || Locals Prefered

iPivot, LLC

•

Jersey City, New Jersey, USA

Contract

Job Title: Azure Data Engineer Location: New Jersey -Hybrid Contract - W2 only Job Description: Azure, ETL, Devops, Power Platform. Requirements: Experience with Azure/ Power platform Data technologies like Data Factory, Data Fabric, Data Lake Storage. SQL Database, Data Explorer, Synapse Analytics, PurviewExpertise knowledge with Azure Identity management such as AKV, UAMI.Fluent technologies like Spark, Kafka and Hive,Demonstratable knowledge of applying data engineering processes and princ
Easy Apply
Posted 7 days ago | Updated 4 days ago

Senior Data Architect

Brains Workgroup, Inc.

•

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite
Easy Apply
Posted 60+ days ago | Updated 11 hours ago

Lead AI-ML Developer

HAN IT Staffing Inc.

•

New York, New York, USA

Third Party, Contract

Job: Lead AIML Developer Location: NYC, NY onsite Day 1 Duration: Long Term Client: Direct $/hr on C2C Job Description : Responsibilities: Design and implement machine learning models and algorithms for classification, regression, clustering, and recommendation systems.Collaborate with data scientists, software engineers, and product teams to integrate AI solutions into production environments.Analyze large datasets to extract meaningful insights and improve model performance.Research and stay
Easy Apply
Posted 8 hours ago

Data Engineer

SG Analytics Inc.

•

New York, New York, USA

Full-time

Job Overview: We seek a highly skilled and motivated Data Engineer with strong expertise in Python, PySpark, AWS, Databricks, and Snowflake to join our dynamic team. The ideal candidate should have hands-on experience with Spark optimization, SQL data processing, and AWS tools and technologies. Exposure to Informatica and data streaming tools is a plus. Key Responsibilities:Design, develop, and optimize scalable data processing pipelines using Spark and PySpark.Implement Spark optimization tech
Easy Apply
Posted 27 days ago | Updated 17 days ago

Data Engineer

Photon

•

Jersey City, New Jersey, USA

Full-time

Hi All, We have below opening for Data Engineer | Onsite - Jersey City, NJ, USA, if you are interested please share your updated resume to Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment
Easy Apply
Posted 53 days ago | Updated 7 days ago

.Net Developer

SRISYS Inc.

•

New York, New York, USA

Contract

100% W2 Position only. Job Title: .Net Developer Location - New York Duration: 6+ Months (Contract to Hire) Responsibilities: Understand complex business systems and workflows and explain them to other developersDevelop component designs that work cohesively in the context of existing architectureExercise judgment within defined standard practices and procedures to analyze, test, design, program, debug, modify and implement system requirementsWork closely with the business units and stakeholders
Easy Apply
Posted 17 days ago

Sr. Data Engineer

LGL Technologies

•

Rutherford, New Jersey, USA

Contract

Title: Sr. Data Engineer Location: Rutherford, NJ (ONSITE REQUIREMENT 3 days per week) JOB DESCRIPTION: Responsibilities: Manage multiple teams of professionals to accomplish established goals and conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions) Provide strategic influence and exercise control over resources, budget management and planning while monitoring end results Utilize in-depth knowledge of concepts and procedures within own area and basic
Easy Apply
Posted 5 days ago | Updated 11 hours ago

Senior Software Engineer, Data Platform

C2R Ventures

•

New York, New York, USA

Full-time

Job DescriptionHighly successful and growing quant trading firm seeking a Senior Software/Data Engineer to help build out the nex-gen cloud-based platform and its leading-edge capabilities. This is a business critical platform for a tech forward financial firm that's success depends on the robustness and speed of their infrastructure. Qualifications BS in Engineering or Computer Science2+ years of Object Oriented Programming (Python)Experience working with large data sets, both structured and un
Posted 2 days ago | Updated 1 hour ago

JAVA/Scala Developer @ New York, NY

ProCorp Systems Inc.

•

New York, New York, USA

Contract, Third Party

Hello, Hope you are doing well, Title: Java/Scala Developer Location: New York, NY Duration: Long term Rate: DOE Job Description: BIG on scala/spark development. So someone with strong programming skills and some experience in spark/scala will work.Understanding code versioning system, PR, PR builds and branching strategies. (GitHub, bit bucket)Good understanding of below testing framework and its importance; unit testing, integration testing,BDD and Regression. (Junit, cucumber, concordion, etc
Easy Apply
Posted 3 days ago | Updated 20 hours ago

Software Engineer (Data & ML Infrastructure) @ Mission-Driven Series A Startup NYC

Averity

•

New York, New York, USA

Full-time

Job DescriptionSoftware Engineer (Data & ML Infrastructure) Join a Mission-Driven Series A Startup Transforming Main Street Who We Are We re a well-funded Series A startup, backed by top tech founders and renowned entrepreneurs across industries. Our mission? To help small business owners take control of their future and push back against the corporate giants that have dominated Main Street for too long. Based in Lower Manhattan, we are a close-knit, on-site team that thrives on collaboration an
Posted 2 days ago | Updated 1 hour ago