Apache Spark Jobs in New York, NY

Refine Results
1 - 20 of 382 Jobs

Java Developer with Scala & Spark experience-Whippany NJ -C2C-CH

Empower Professionals

Edison, New Jersey, USA

Third Party, Contract

Role: Java Developer with Scala & Spark experience Locations: Whippany, NJ (Hybrid Onsite) Duration: 12+ Months Contract Note: Candidate needs to be in the office 3 Days every week. Local Or Candidates From Nearby States Only. Roles & Responsibilities: Analyzing requirements, provide estimates, develop performant Java, SQL, Unix Shell script in timeNegotiating with stakeholders about timelines and scopeRepresenting code changes impact to technical teamParticipating on production calls and help

Spark and Scala Developer

Avanciers LLC

Weehawken, New Jersey, USA

Full-time

Role Spark and Scala Developer Location: Weehawken, NJ (Day 1 Onsite - No Remote) Yrs. of experience: 8+ Yrs. Mode of employment: Full-Time Note: Mid exp level Developer: Scala, SQL, Spark, Spring, Microservices, Distributed computing fundamentals, Cloud computing. Candidate needs to go through the coding assessment during the L1 Interview and make sure IDE (Eclipse or IntelliJ) is installed in their machine. Job Description: 8+ years of IT experience and minimum 5+ years of experience in Clou

Senior Software Engineer, Back End (Python, SQL, Scala, Spark)

Capital One

New York, New York, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Software Engineer, Back End (Python, SQL, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software En

Senior Data Engineer (Python, Scala, or Spark)

Capital One

New York, New York, USA

Full-time

West Creek 3 (12073), United States of America, Richmond, Virginia Senior Data Engineer (Python, Scala, or Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about

Senior Software Engineer Backend (Python, SQL, ETL, Spark, AWS)

Capital One

New York, New York, USA

Full-time

Center 1 (19052), United States of America, McLean, Virginia Senior Software Engineer Backend (Python, SQL, ETL, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software E

Lead Software Engineer - Python Spark

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking in Wealth Management technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solu

Staff Data Engineer - Spark, Python, Scala

SiriusXM

New York, New York, USA

Full-time

Who We Are: SiriusXM and its brands (Pandora, SXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listeners -- in the car, at home, and anywhere on the go with connected devices. Our vision is to shape the future of audio, where everyone can be effortlessly connected to the voices, stories and music they love wherever t

Data Engineer Scala, AWS, Spark - Major Entertainment Company

TechLink Resources

New York, New York, USA

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Responsibilities: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needsBuild next-gen cloud based big data infrastructure for batch and streaming data appli

Full time Position || Technical Lead - Spark / Scala & Kubernetes || Remote

SanKar Inc

Remote

Full-time

Title Technical Lead - Spark / Scala & KubernetesLocation Remote (EST Working hours)Type - Fulltime Job Description: Excellent Spark-Scala SkillsExcellent Cloud (Azure preferable) skillsKubernetes Skill and experience is mandatory.

Big Data Developer (Spark, Scala, AWS, AWS Elastic MapReduce)

People Force Consulting Inc

Remote

Third Party, Contract

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: Spark frameworkScalaAWS Elastic MapReduce - Strong ExperienceAWSJob Description Requirements: Bachelors degree preferably Computer Science, Engineering, or other quantitative fields 6+ years of related experience in designing and implementing enterprise applications using big data 5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocki

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Spark Scala Developer

Infosys Technologies Ltd

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i

Big Data Developer

OJUS LLC

Jersey City, New Jersey, USA

Contract

Client TCS/Citi Bank Location = Jersey city/ It is onsite Role C2C Here is the JD Big Data Developer (Location: NJ) On-Site Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing er

Data Engineer

Reveille Technologies

Jersey City, New Jersey, USA

Contract

Job Description:- Develop and maintain data platforms using Python, Spark, PySparkHandling migration to PySpark on AWS Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity. Collaborate with cross functional teams to understand data requirements and design solutions that meet business needs. Implement and manage agents for monitoring, logging, and automation within AWS environments

Python Developer

Innova Solutions, Inc

Jersey City, New Jersey, USA

Full-time

Innova Solutions is immediately hiring for a Python Developer Position type: Contract Duration: 12+ Months Location: Jersey City, NJ /New York City, NY- Hybrid As a Python Developer: You will be responsible for hands-on application development to support the current and target process, as well as partnering with the multiple Technology teams to implement the target architecture and migration to strategic platform. Typically requires 5 to 10 years of applicable experience. The ideal candidate wil

SQL Developer

Innova Solutions, Inc

Jersey City, New Jersey, USA

Contract

Innova Solutions is immediately hiring for SQL Developer Hybrid Role: 3 days Onsite 2 days Remote Job Role: SQL Developer Job Duration: Long Term Job Location: Jersey City, NJ Role and Responsibilities: Enterprise Technology s GWD Technology team is working on and implementing innovative solutions to improve forecasting processes and support operational excellence. This role will be responsible for working closely with the technical leads and Product Owners to deliver support data, analytics and

Cloud Developer

Custom Staffing

New York, New York, USA

Contract

Cloud Developer 24-00088 90.00-120.00 hourly W2 New York City (local to area able to work onsite 2 days a week in NYC) No Corp to Corp or 3 rd party agencies Must be able to pass a security clearance Required: Java, AWS, Micro-services, SQL, Docker, Python and Spark, data bricks We are looking for a AWS Cloud Developer to join our team of professionals and work onsite 2 days a week in NYC. Must be local to NYC area. In this position you will: Work on migrating applications from an on-premises