Apache Spark Jobs in New York

Refine Results
1 - 20 of 434 Jobs

Senior Spark Architect

Infosys Technologies Ltd

Jersey City, New Jersey, USA

Full-time

Role: Sr. Spark Architect Location: Newport, NJ Required Qualifications Candidate must be located within commuting distance of Newport, NJ or be willing to relocate to the area. This position may require travel to project locationsBachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of educationAt least 11 years of Information Technology experienceAll applicants authorized

spark developer

Rivi Consulting Group

New York, New York, USA

Contract

Responsibilities will include: Understand and implement tactical or strategic solution for a given business problem Discussion with stakeholders on business needs and technology requirements. Define and derive the strategic solutions as well as identify tactical solutions when necessary. Write technical design & other solution documents per Agile (SCRUM) standards. Perform data analysis to aid development work and other business needs. Perform unit testing of the developed code leveraging

Sr. Java and Spark Core Developer

SANS

New York, New York, USA

Full-time

Sr. Java with Spark core expertise. Must work more than 10+ years in USA and more than 3+ years of solid Spark core development. Corp to corp is fine. Must be local to NYC/NJ to be considered. NO REMOTE workers and no relocation allowed as 2nd round must be in-person interview. Seeking candidates with capital markets, investment banking experience with Market Risk financial market data systems. Responsibilities: Must have Spark core development expertise of 3+ years.Design, develop, and maintain

Java with Spark/ Python

Tanisha Systems, Inc.

Jersey City, New Jersey, USA

Full-time, Contract

Job description:-Role: Java with Spark/ Python Location: Jersey City, NJ (5 days Onsite ) Experience: 10+Years Type: Contract Job Description: Required Qualifications, capabilities, and skills Proven Senior Developer with expertise in Oracle, Spark SQL, Java, Python/Shell scripting Strong experience with AWS services and cloud-based architectures Hands on practical experience in system design, application development, testing and operational stability Experience in developing, debugging and main

Direct Client:: W2 position:: Need Sr. Hadoop Developer with Spark/Scala and Healthcare Experience:: 100% Remote

Synergy Technologies, LLC

Remote

Contract

W2 contract to Fulltime position No Sponsorship required Job Title: Sr. Hadoop Developer Location: Jacksonville, FL (100% remote) Duration: Long Term Job description: A Hadoop developer is responsible for the design, development and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or mathematics. IT Developers are responsible for develo

Data Engineer with Spark

CitiusTech

Remote

Full-time

Responsibilities: Design, develop, and maintain scalable data pipelines using Spark and Scala. Implement ETL processes to transform and load data into Snowflake and other data warehouses. Develop and optimize Hive queries for efficient data extraction and transformation. Collaborate with data scientists and business analysts to ensure data quality and consistency. Build and maintain data models and ETL processes to support business intelligence and reporting tools. Monitor and troubleshoot data

Data Engineer - Spark

Exl Service

Remote

Full-time

Company Overview: EXL Service is a global technology and analytics company specializing in delivering innovative, scalable, and high-quality technology solutions. Our global team consists of experienced professionals in design, software engineering, analytics, and data science, committed to solving complex business problems and enabling our clients to achieve their strategic goals. We focus on solving customer business problems by delivering products designed with best-in-class engineering pract

Java Spark Developer

SelSoft Inc.

Remote

Contract, Third Party

Greetings, Title: Java AWS Developer Location; New York City, NY & Columbus, OH (5 Days onsite) Note : Relocation is also fine Interested candidates kindly send your updated resume to Job Description: Strong Application Development work experience - Agile environment preferred. Solid application design, coding, testing, maintenance and debugging skills Experience with Junit and Cucumber testing. Experience with APM Monitoring tools and logging tools like Splunk Proficiency with JIRA, Confluence

Azure Data Engineer (PowerShell, Spark, ETL)

Spar Information Systems

US

Full-time, Part-time, Contract, Third Party

Hello Everyone, Hope you are doing good My name is Pavan and I work with SPAR Information System., I have a great opportunity for you, please find the job details below, if you are interested in applying please send me your updated resume and best time for you to discuss about this opportunity in details. Role: Azure Data Engineer Location: Remote Duration: Long term contract JD Experienced SR Data Engineer: 8+ years of experience working with data infrastructure, ETL processes, and large-sca

Spark Middleware Engineer - Lead Software Engineer

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple tec

Senior java developer with Spark - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTE

Provish Consulting

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: 100% REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candid

Java FSD with Python

Donato Technologies Inc

Jersey City, New Jersey, USA

Contract

Job Title: Java FSD with PythonJob Location: New Jersey, NY(5 Days Onsite)Experience: 8+ Years 45 Miles from the client location Required Qualifications, capabilities, and skills:Proven Senior Developer with expertise in Oracle, Spark SQL, Javaa, Python/Shell scriptingStrong experience with AWS services and cloud-based architecturesHands on practical experience in system design, application development, testing and operational stabilityExperience in developing, debugging and maintaining code in

Data Engineer/Big Data Engineer - NY/NJ / Tampa

Photon

Jersey City, New Jersey, USA

Full-time

Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment with business requirements. Work with the stakeholders to understand and gather requirements and produce business specifications Validate so

Sr Data Engineer

Photon

Jersey City, New Jersey, USA

Full-time

Job Title: Sr Data Engineer Location: Jersey City, NJ / NYC, NY / Tempa, FL. Duration: Fulltime Permanent (No C2C) Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment with business requirement

Data Engineer

Photon

New York, New York, USA

Full-time

Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment with business requirements. Work with the stakeholders to understand and gather requirements and produce business specifications Validate so

Java / DevOps automation Consultant

SOHO Square Solutions

New York, New York, USA

Contract, Third Party

Description: Required Skills: - Relevant experience 3-5 Years - Strong proficiency with Java (Spring) and Scala - Proficiency with Relational Databases such as SQL Server, Oracle, Sybase or DB2, as well as Big Data repositories such as Hadoop and MongoDB - Experience with modern SDLC methodologies including Agile - Strong Written and Oral Communication skills Nice to Have Skills: - Familiar with Apache Spark for parallel processing - Familiar with UNIX/Linux application debugging - Famil

Senior Data Engineer

Photon

Jersey City, New Jersey, USA

Full-time

Role: Senior Data EngineerLocation: NY/NJ/Tampa (Onsite) Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment with business requirements. Work with the stakeholders to understand and gather req

Senior Data Architect

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

Big Data Developer

Capgemini America, Inc.

Jersey City, New Jersey, USA

Full-time

Position Title : Big Data Developer Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in software development, data engineering, and large-scale distributed systems. This role requires a deep understanding of big data technologies and the ability to lead and implement enterprise-scale