Apache Spark Jobs in New York

Refine Results
1 - 20 of 410 Jobs

Spark Scala Developer (with Java)

Katal Tech

Jersey City, New Jersey, USA

Third Party, Contract

ROLE TITLE : Spark Scala Developer (with Java) ROLE LOCATION(S): New Jersey, NJ(HybriD) Responsibilities: Design, develop, and maintain Spark Scala applications for data processing and analysis.Utilize Java programming language for implementing custom functionalities and optimizations within Spark applications.Build efficient and scalable data pipelines to process and transform large volumes of data.Collaborate with data engineers and data scientists to integrate machine learning models and al

Lead Software Engineer - Python Spark

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking in Wealth Management technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solu

Java Python Spark Software Engineer III

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the Corporate Investment Banking - Fusion Data Platform, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business funct

Staff Data Engineer - Spark, Python, Scala

SiriusXM

New York, New York, USA

Full-time

Who We Are: SiriusXM and its brands (Pandora, SXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listeners -- in the car, at home, and anywhere on the go with connected devices. Our vision is to shape the future of audio, where everyone can be effortlessly connected to the voices, stories and music they love wherever t

Software Engineer-Spark

Veear

Remote

Contract

Title: Software Engineer (Spark) Duration: 03+ months contract (possible extension) Location: Cupertino, CA(Remote) Job Summary: Strong understanding of distributed systems and cloud computing principles.Demonstrated experience with Apache Spark.Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud.Extensive experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and networking (VPC, N

Big Data Developer (Spark, Scala, AWS, EMR)

People Force Consulting Inc

Remote

Contract, Third Party

Role: Big Data Developer - Healthcare Remote Minimum: 12+Years Mandatory Skills: SparkScalaAWS EMRAWSJob Description Requirements: Bachelor s degree preferably Computer Science, Engineering, or other quantitative fields6+ years of related experience in designing and implementing enterprise applications using big data5+ years of experience in a senior level engineering role mentoring other engineers, which includes engineering best practices, unblocking, code reviews, unit testing, managing dep

Databricks Developer ( Spark , PySpark ) | Remote

Bramkas Inc.

Remote

Contract

Title: Databricks Developer Experience: 7 + yrs exp Position Type : Contract Location : Remote Must Have Skill : Spark , Pyspark ,Python ,Data BricksWe are seeking a skilled Databricks Developer to join our team . As a Databricks Developer, you will be responsible for designing, building, and maintaining data pipelines and analytics solutions using the Databricks platform. You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement solutions

Data Architect ( Spark, PySpark, and Python) | Full Time Position | Remote

Bramkas Inc.

Remote

Full-time

Data Architect Location: RemoteEmployment Type: Full-time PositionExperience: 9+ yrs expMust have : Data Architect , Spark , Pyspark , PythonWe are currently seeking a skilled and experienced Data Architect to join our team. The ideal candidate will have a strong background in data architecture, along with expertise in Spark, PySpark, and Python. As a Data Architect, you will play a critical role in designing and implementing data solutions to support our organization's objectives. Responsibili

Senior Spark Data Engineer

Randstad Digital

Remote or Akron, Ohio, USA

Full-time

job summary: Senior Level Data Engineer - Fully REMOTE - Direct Hire! Our client is seeking a Data Engineering Leader to join their team and serve as Subject Matter Expert and Mentor, as they build data pipelines and drive analytic solutions. This position requires a Bachelor's Degree in Computer Science, MIS, or related field, with at least 8-10 years of related experience. Bonus Eligible, Minimal Travel, and Opportunities for career growth! The following skillsets are strongly preferred: Expe

Data Quality Engineer - Spark/PySpark/Databricks - Looking Who Can Work On Our W2

IntelliSavvy

Remote

Contract

Job Description Technical Skills: Azure Databricks, Synapse Analytics, SQL Hyperscale. Python, and PySpark for test automation for test frameworks in Azure environments Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Familiarity with data modeling, ETL processes, and data warehousing concepts. 6-10 years of experience in QA automation, with 5+ using Spark/PySpark. Key Responsibilities Develop comprehensive test strategies with a clear understa

Software Engineer (Spark)

Bayside Solutions

Remote or

Contract

Software Engineer (Spark) W2 Contract Salary Range: $145,600 - $166,400 per year Location: Seattle, WA - Remote Role Requirements and Qualifications: Strong understanding of distributed systems and cloud computing principles Demonstrated experience with Apache Spark Extensive hands-on experience and strong understanding of Kubernetes environments, preferably on AWS Cloud Experience with major cloud providers, especially with AWS services related to computing (EKS, EC2), storage (S3), and net

Senior Data Engineer - Scala, Spark, Kafka, Azure

BayOne Solutions

Remote

Full-time

Job Title: Senior Data Engineer Job Type: Full Time Remote Eligible: Yes Skills: Scala programming, Spark, Kafka, Azure Responsibilities: Streamline the intake of the raw data into our Azure Data lake.Perform production support and deployment activities.Proactively drive the execution of our core data engineering, business intelligence, and data warehouse frameworksBuild data pipelines from systems such as CRM, Ecommerce etc. with the emphasis on scalability and reliabilityLeverage central data

Spark Scala Developer

Infosys Technologies Ltd

Remote

Full-time

Job Description :In the role of Spark Scala Developer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to i

Hiring Senior Data engineer with Python - Jersey City NJ - Contract

MARVEL INFOTECH Inc

Jersey City, New Jersey, USA

Contract

Role: Python - Advanced Location: Jersey City NJ only (Must report onsite day 1) Hybrid: Mon, Tues, and Thursday in office Need strong Python (backend development), Spark (performance tuning, expertise), and AWS. Prefer 6+ years of experience. Roles and Responsibilities: Summary: Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems Develops

Python Developer

Altezzasys

Jersey City, New Jersey, USA

Contract

Job title: Python Developer Location: Jersey City, NJ (Hybrid) Contract this position is open for only W2 Jon Description: Summary: Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems Develops secure and high-quality production code, and reviews and debugs code written by others Identifies opportunities to eliminate or automate remediation of

Data Engineer

Apolis

Hoboken, New Jersey, USA

Full-time

Data Engineer Direct Hire | Permanent FTE 2 days/week in Hoboken, NJ Job Description: Team is responsible for all the Anomaly Detection. They build algorithms and Pricing Models to show where anomalies are occurring. They also do platform develop for specific Platforms that do the same thing. Candidate will be responsible for designing, developing, testing, and deploying their code. A lot of the work also revolves around pipeline development and job development. Needs: PythonSPARKPySparkGoogle C

Lead Big Data Engineer

PETADATA

Jersey City, New Jersey, USA

Full-time

Position: Lead Big Data Engineer Location: Jersy City, NJ (Hybrid) Experience: 10+ Years Work type: Fulltime(W2) only PETADATA is currently looking to hire for the position of Lead Big Data Engineer for one of their clients. Roles & Responsibilities: The Ideal candidate should be able to define the overall strategy and roadmap for Data-driven decision-making and work towards Big Data Technology solutions implementation. Provide technical leadership and guidance towards creating cutting-edge

Big Data

OJUS LLC

Jersey City, New Jersey, USA

Contract

Big Data Developer Strong Experience in Spark Scala Programing. Very extensive experience on Hive, Impala, Kafka & Hbase. Should have good knowledge on Spark Streaming. Clear understanding of Hadoop Ecosystem & Spark Architecture. Must have experience in Unix Shell Scripting, PL/SQL & Autosys Scheduler. Should have used udeploy, TeamCity, SharePoint. Should be expert in debugging & tracing errors/exceptions. occurred in Spark job execution. Must have experience working in different SDLC phases i

Senior Data Engineer @ NYC, NY (On-site)

Techno-Comp, Inc.

New York, New York, USA

Contract

Job Title: Senior Data Engineer Location: New York, NY Duration: Long Term Contract Key Skills: Analytics, SQL, Python, SAAS Platform, Data modeling, Spark, Scala and Kafka In this role, you will work directly with our Data, Engineering, Operations, Data Science, Go-to-Market, and Finance teams to support the organization's data processing and analytics needs. You will serve as the internal expert on all things data engineering, empowering your peers with your expertise to collectively build a w

Java with Kafka - Jersey City, NJ

AIT Global, Inc.

Jersey City, New Jersey, USA

Full-time, Third Party

Job Title: Java with Kafka Location: Jersey City, NJ Job Description: Proficient in Java, with a good knowledge of its ecosystems Good knowledge on Kubernetes and/or Kakfka. Familiarity with concepts of MVC, JDBC, and RESTful Experience with both external and embedded databases Creating database schemas that represent and support business processes Design, implementation, testing and deployment, and adds an additional skill (s) on top of traditional front/back end covered in the Full Stack Dev