Apache Spark Jobs in New York

Refine Results
1 - 20 of 410 Jobs

Senior Software Engineer, Back End (Python, SQL, Scala, Spark)

Capital One

New York, New York, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Software Engineer, Back End (Python, SQL, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software En

Spark and Scala Developer

Wizcom Corporation

Weehawken, New Jersey, USA

Full-time

Role Spark and Scala Developer Location: Weehawken, NJ (Day 1 Onsite - No Remote) Yrs. of experience: 8+ Yrs. Mode of employment: Full-Time Note: Mid exp level Developer: Scala, SQL, Spark, Spring, Microservices, Distributed computing fundamentals, Cloud computing. Candidate needs to go through the coding assessment during the L1 Interview and make sure IDE (Eclipse or IntelliJ) is installed in their machine. Job Description: 8+ years of IT experience and minimum 5+ years of experience in Clo

Manager, Software Engineering, Full Stack (Spark, React, AWS)

Capital One

New York, New York, USA

Full-time

West Creek 1 (12071), United States of America, Richmond, Virginia Manager, Software Engineering, Full Stack (Spark, React, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Full Stack Software Eng

Senior Data Engineer (Python, Scala, or Spark)

Capital One

New York, New York, USA

Full-time

West Creek 3 (12073), United States of America, Richmond, Virginia Senior Data Engineer (Python, Scala, or Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about

Spark and Scala Developer

Avanciers LLC

Weehawken, New Jersey, USA

Full-time

Role Spark and Scala Developer Location: Weehawken, NJ (Day 1 Onsite - No Remote) Yrs. of experience: 8+ Yrs. Mode of employment: Full-Time Note: Mid exp level Developer: Scala, SQL, Spark, Spring, Microservices, Distributed computing fundamentals, Cloud computing. Candidate needs to go through the coding assessment during the L1 Interview and make sure IDE (Eclipse or IntelliJ) is installed in their machine. Job Description: 8+ years of IT experience and minimum 5+ years of experience in Clou

Lead Software Engineer - Python Spark

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking in Wealth Management technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solu

Position: Sr. Hadoop Developer with Spark with Healthcare Domain Needed Location :Jacksonville, FL ( Remote Work )

Synergy Technologies, LLC

Remote

Contract

Hi, Synergy Technologies is a leader in technology services and consulting. We enable clients across the world to create and execute strategies .We help our clients find the right problems to solve, and to solve these effectively. We bring our expertise and innovation to every project we undertake Position: Sr. Hadoop Developer with Spark with Healthcare Domain NeededDuration : ContractLocation : Jacksonville, FL( Remote Work ) Healthcare Domain NeededDirect ClientLooking for Healthcare Domain o

Bigdata Developer With Spark & Scala EMR

E-Solutions, Inc.

Remote

Third Party

Job title: Bigdata Developer With Spark & Scala EMR Location: Remote Mandatory Skills: Spark, Scala EMR and AWS JD Bachelor's degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing deployments, te

AWS Solution Architect with Strong Spark, Scala experience-Remote

People Force Consulting Inc

Remote

Contract, Third Party

Job Description: . Data heavy experience. Will be responsible for making design changes to PDM & Symphony databases, designing solutions, troubleshooting data, etc.So ideally - AWS Solutions Architect with Experience in AWS Services like S3, EC2, EMR, Lambda, Glue, etc. + Experience with AWS Aurora & Redshift + Experience in Spark & Scala + Experience data architect who can make design changes on data bases. Need a strong AWS data architect with very strong coding skills.Principal responsibiliti

Data Engineer Scala, AWS, Spark - Major Entertainment Company

TechLink Resources

New York, New York, USA

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Responsibilities: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needsBuild next-gen cloud based big data infrastructure for batch and streaming data appli

Big Data Developer (Spark, Scala, AWS, AWS Elastic MapReduce)

People Force Consulting Inc

Remote

Third Party, Contract

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: Spark frameworkScalaAWS Elastic MapReduce - Strong ExperienceAWSJob Description Requirements: Bachelors degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocki

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Job Description: As a Senior Spark Data Engineer, you will play a pivotal role in designing, developing, and optimizing data processing pipelines using Apache Spark. You will work closely with cross-functional teams to understand business requirements and translate them into scalable and efficient data solutions. Your expertise in SQL, Python, Databricks, and Spark will be critical in ensuring the seamless processing of large-scale imagery and big data sets. This role offers an exc

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Scala Developer (Hybrid onsite min 12+ years expereince required)

Xoriant Corporation

New York, New York, USA

Contract, Third Party

Job Title : Scala Developer Client Location: NYC, NY (Hybrid 3 days a week onsite) Duration : Long term contract Contract: W2 / C2C / Independent Contractor Job Requirements: We would like to hire hands on Scala developer that will be responsible for delivering a high quality code in a big data platform, Unit testing in automated test framework, automated DevOps release and documentation of technology solutions for transaction monitoring, customer activity review, Optimization of scenarios and o

Data Architect

Fortune Global Solutions, LLC

Jersey City, New Jersey, USA

Third Party, Contract

Job Title: Data Architect Location: New Jersey (Onsite) Duration: Long Term Skillset Needed:. More than 8 years of relevant experience in data engineering tools like Spark, Hadoop, Azure Data pipelines , Azure Data factory, Azure Data Lake Storage, Databricks, Delta Lake, Python, SQLServer, and experience with other cloud providers AWS, Google Cloud Platform. (experience preferably with insurance domain) Strong knowledge and experience designing and implementing solutions on Databases like Had

Data Engineer

ApTask

New York, New York, USA

Full-time

Job Title Sr Data EngineerRelevant Experience (in Yrs) 8-10 yrs Must Have Technical/Functional Skills Apache Spark, Scala/ Python and PySparkExperience Required Min. 5-7 years hands on experience working in data modelingRoles & Responsibilities Work on migrating applications from an on-premises location to the cloud service providers. Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation. Develop, modify, extend

Senior Data Engineer (Machine Learning)

W3Global

Remote or Jersey City, New Jersey, USA

Full-time

Senior Data Engineer (ML/ ETL) Full Time Remote Responsibilities: bold">Collaborate with machine learning practitioners to understand algorithm feature and data requirements bold">Work with Engineering teams to collect required data from internal and external systems bold">Develop and maintain production-grade batch and streaming pipelines bold">Setup orchestration and automation of ETL jobs using tools such as Airflow and Jenkins bold">Improve and extend existing data infrastructure servi

Data Engineer

Open Systems Technologies

New York, New York, USA

Contract

A financial firm is looking for a Data Engineer to join their team in NYC. Pay: $900-1000/day Qualifications: A Bachelor's or Master's degree in Computer Science, Engineering, or a related fieldExperience in data engineering, particularly with big data technologies and environmentsProficiency in Python, SQL, and Apache SparkExperience with cloud services and architectures, preferably with hands-on experience in AWS, Azure, or Google Cloud PlatformUnderstanding of data modeling, ETL processes, an

Python Developer

Innova Solutions, Inc

Jersey City, New Jersey, USA

Full-time

Innova Solutions is immediately hiring for a Python Developer Position type: Contract Duration: 12+ Months Location: Jersey City, NJ /New York City, NY- Hybrid As a Python Developer: You will be responsible for hands-on application development to support the current and target process, as well as partnering with the multiple Technology teams to implement the target architecture and migration to strategic platform. Typically requires 5 to 10 years of applicable experience. The ideal candidate wil

Cloud Developer

Custom Staffing

New York, New York, USA

Contract

Cloud Developer 24-00088 90.00-120.00 hourly W2 New York City (local to area able to work onsite 2 days a week in NYC) No Corp to Corp or 3 rd party agencies Must be able to pass a security clearance Required: Java, AWS, Micro-services, SQL, Docker, Python and Spark, data bricks We are looking for a AWS Cloud Developer to join our team of professionals and work onsite 2 days a week in NYC. Must be local to NYC area. In this position you will: Work on migrating applications from an on-premises