Apache Spark Jobs in New York

Refine Results
1 - 20 of 421 Jobs

Scala Spark Engineer - Onsite in Broadway,NY

Chabez Tech LLC

New York, New York, USA

Contract, Third Party

Role: Scala Engineer (Spark, Java) Location: Broadway, NY - Onsite Requirement & Preference: 9 to 10 years of relevant experience. Extensive experience in Scala Engineering. Hands-on experience with Big-Data Technologies such as Spark. Strong background exposure to Java.

Scala/Spark Developer

Xoriant Corporation

New York, New York, USA

Full-time

Title: Scala Developer (Scala, Hadoop & Spark) Duration: 12+ Months (Possible Extensions) Location: NYC, NY Client Industry: Financial Services Responsibilities will include: Understand and implement tactical or strategic solution for a given business problemDiscussion with stakeholders on business needs and technology requirements.Define and derive the strategic solutions as well as identify tactical solutions when necessary.Write technical design & other solution documents per Agile (SCRUM) s

Big Data Java Spark Scala Developers

Kforce Technology Staffing

Jersey City, New Jersey, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a team of Big Data Java Spark Scala Developers. These candidates should be comfortable working in a fast-paced environment and can help build APIs, calculators, on new cutting-edge cloud and big data technologies such as AWS EMR, EC2, Scala Spark, Scala, Snowflake. This job is available in the following locations: New York City, NJ, Eastern PA & CT. Responsibilities: * Big Data Java Spark Scala Developers executes standard software solutions

Java Spark Developer

Tanisha Systems, Inc.

New York, New York, USA

Contract

Job Title : Java Spark Developer Location : Plano, Tx ( Only Local Candidates ) Day1 onsite Number of Openings : 2 Strong hands on Experience in Spark with Java with minimum 7 years in Java spark and lead the team " Advanced experience in ETL and data wrangling using language Java is a plus " Proficiency in Java/J2EE, Web Service, Cloud, Micro service, Spring Boot, Kafka, Control -M, Unix Shell Scripting ad Kubernetes. " Experience in developing, deploying and administering Java applications ,

Spark/ Scala Engineer

Aptino

Remote

Contract

Hands on experience Spark, Scala, Python Strong experience with big data methods and with retrieving data Perform detail exploratory data analysis various file formats (Parquet, AVRO, CSV, JSON). Build and enhance Spark-based frameworks Experience with Single Store, Snowflake, Kafka, Nifi and AWS big data technologies is good to have. Experience of architecting data using cloud technologies. Extensive Hands-on experience with Azure cloud services.

Spark Developer

Amiseq Inc.

Remote

Contract

Spark Developer Remote 12 Months Contract We are working with a strategic customer and looking specifically for an individual with: Deep expertise when it comes to identifying and fixing bottlenecks in Spark jobs. This role will also require structured streaming expertise to build/optimize jobs. Please let us know if you can share a couple of profiles, we will be happy to review them asap! Identifying and Fixing Bottlenecks in Spark Jobs: Dive deep into Spark applications to identify perfor

Spark Developer - 10+ years of experience

Next Level Business Services, Inc.

Remote

Third Party, Contract

Spark Developer - 10+ years of experience 12+ months Remote This role requires a person to have strong development background with 5+ years of Hands-On Application Development experience. 5+ Years Experience in Spark and Python. 5+ Years Experience of DataBricks(DBRX models.) 3+ Years Experience working with AZURE AI studio. Strong Debugging skills (Stack traces, log files, and other system outputs) Must have worked on Agile driven development. Should be pro-active in providing technical solu

Data Engineer Scala, AWS, Spark - Major Entertainment Company

TechLink Resources

New York, New York, USA

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Responsibilities: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needsBuild next-gen cloud based big data infrastructure for batch and streaming data appli

Remote Hadoop Developer (Spark/Scala)

Software Guidance & Assistance

Remote or Jacksonville, Florida, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Remote Hadoop Developer (Spark/Scala) - Remote for a CONTRACT assignment with one of our premier Healthcare Services clients based in Jacksonville, FL . This role will be 100% remote. Potential to convert to full-time for the right candidate. Top Skills Needed: Hadoop Spark/Scala Java AI Technologies Preferred Responsibilities : Responsible for the design, development and operations of systems that store and manage large am

Lead/Senior Data Engineer - Scala/Spark/Kafka/Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Data Engineer

Simplyfy Solutions Inc

New York, New York, USA

Contract

We have several urgent openings for Google Cloud Platform Data Engineers with various clients. Please see the job description below. Role and Responsibilities: Design, develop, and maintain data pipelines on Google Cloud Platform (Google Cloud Platform)Implement and manage ETL processes to ensure high data quality and availabilityCollaborate with cross-functional teams to understand data requirements and deliver scalable solutionsOptimize data storage and retrieval processes to improve system pe

Sr. Data Engineer

System Soft Technologies

New York, New York, USA

Contract

Need Active Secret Clearance or higher As an Engineer - you will help develop and deploy technical solutions to solve our customers hardest problems, using our platform to integrate data, transform insights, and build first-class applications for operational decisions. You will leverage everything around you: core company products, open source technologies (e.g. GHE), and anything you and your team can build to drive real impact. In this role, you work with customers around the globe, where you

Full stack Java Developer

ApTask

Jersey City, New Jersey, USA

Third Party, Contract

Technical Skills Over 10+ Years of experienceMonitor and optimize the performance of Spark applications and AWS resources.Develop and maintain web applications using Java, React, and Angular.Collaborate with cross-functional teams to define, design, and ship new features.Ensure the performance, quality, and responsiveness of applications.Participate in code reviews and provide constructive feedback.Stay up-to-date with the latest industry trends and technologies.Should have excellent problem-sol

Python - Intermediate

Pinnacle Group

Jersey City, New Jersey, USA

Full-time

Python developer Jersey City New Jersey (hybrid, 3 days onsite) Contract to hire Must Have: Python and a Spark Developer. Extensive worked on Spark. Public cloud AWS experience. Backend project. Looking for someone more on the data side. Working with Internal Product partner. Nice to Have: Financial domain is nice to have Required Skills: Minimum 6 years of hands-on experience. AWS, Python, Spark Data/Backend Software Developer. Nice to have: Certifications - AWS Solutions architect. Fin

Senior Databricks Engineer

Luxoft USA Inc

Weehawken, New Jersey, USA

Full-time

Project Description: In our agile operating model, crews are aligned to larger products and services fulfilling client's needs and encompass multiple autonomous pods. You will be part of Global Markets Financing stream within Investment Banking division in US. The team is responsible for feature development, modernization and transformation of the platform used by both internal and external users. Responsibilities: We are looking for Senior Cloud data Engineer having at least 15+ years of indust

Scala Developer

OJUS LLC

New York, New York, USA

Contract

4+ years of experience with 2+ in big data technologies. Hands on development in Scala, Spark and HDFS platform. Must have implemented project on Scala/Python platform. Strong oral and written communication skills Desired Skills: Knowledge of Behavior-driven development (BDD) Possess Big data technology certification

Technical Lead / Solution Architect (AI & Client)

SANS

New York, New York, USA

Full-time

Job Description: Technical Lead / Solution Architect (AI & Client) Position Overview: We are seeking a highly skilled and experienced Technical Lead / Solution Architect specializing in Artificial Intelligence (AI) and Machine Learning (Client) to join our dynamic team within the insurance sector. The ideal candidate will have a deep understanding of AI and Client technologies, a proven track record of leading technical teams, and the ability to design and implement innovative solutions that enh

Java BigData Developer with Financial / Capital market Domain Experience

SumasEdge Corporation

New York, New York, USA

Third Party, Contract

Job Description: Minimum 8+ experience in Java, J2EE, Springboot, Microservices, REST APIs.Proven experience as a Java Developer with hands-on experience in Java 8 and Java 11.Knowledge of big data technologies such as Hadoop, HDFS, HBASE and distributed computing frameworks for large-scale data processing.Experience with Apache Spark, Spark SQL, and related Spark ecosystem tools and libraries.Hands-on Linux scripting experience.Excellent communication and collaboration skills, with the ability

Data Engineer

Open Systems Technologies

New York, New York, USA

Contract

A financial firm is looking for a Data Engineer to join their team in NYC. Pay: $900-1000/day Qualifications: A Bachelor's or Master's degree in Computer Science, Engineering, or a related fieldExperience in data engineering, particularly with big data technologies and environmentsProficiency in Python, SQL, and Apache SparkExperience with cloud services and architectures, preferably with hands-on experience in AWS, Azure, or Google Cloud PlatformUnderstanding of data modeling, ETL processes, an

Azure Data Analytics Engineer

Mahaugha LLC

Newark, New Jersey, USA

Contract

Responsibilities: Data Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and ETL (Extract, Transform, Load):Develop and implement data integration processes using Azure Data Factory.Extract data from various sources, transform it, and load it into data warehouses or data lakes.Big Data and Analytics:Utilize big data techn