apache spark Jobs in new york, ny

Refine Results
1 - 20 of 421 Jobs

Senior Spark Architect

Infosys Technologies Ltd

Jersey City, New Jersey, USA

Full-time

Role: Sr. Spark Architect Location: Newport, NJ Required Qualifications Candidate must be located within commuting distance of Newport, NJ or be willing to relocate to the area. This position may require travel to project locationsBachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of educationAt least 11 years of Information Technology experienceAll applicants authorized

Senior Data engineer (Java/Spark) :: Berkeley Heights, NJ :: Need NJ, NY Candidates only, Client is not interviewing Non Locals

Bright Sol

Berkeley Heights, New Jersey, USA

Third Party, Contract

Role: Senior Data engineer (Java/Spark) Location: Berkeley Heights, NJ (100% Onsite) Contract: Long term Need NJ, NY candidates only, client is not interviewing non locals Looking for 10+years profiles Passport Number Required Job Description: Skill Set: Big Data, Java, Spark, SQL, Azure Experience with Big Data Technologies - Spark (Java) for handling large-scale data processing Proficiency in SQL and Database - querying, managing, and manipulating data sets Knowledge of Cloud Platforms - data

spark developer

Rivi Consulting Group

New York, New York, USA

Contract

Responsibilities will include: Understand and implement tactical or strategic solution for a given business problem Discussion with stakeholders on business needs and technology requirements. Define and derive the strategic solutions as well as identify tactical solutions when necessary. Write technical design & other solution documents per Agile (SCRUM) standards. Perform data analysis to aid development work and other business needs. Perform unit testing of the developed code leveraging

Senior java developer with Spark - VP - TAMPA

Citi

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi

Big Data/Spark Principal Architect

AIT Global, Inc.

US

Full-time

Job Title: Big Data/Spark Principal Architect Location: Remote Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Years Of Experience15 to 20 Years Job Description: Hands on with Spark (data frame), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance,

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTE

Provish Consulting

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: 100% REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candid

Spark Middleware Engineer - Lead Software Engineer

JPMorgan Chase & Co.

Jersey City, New Jersey, USA

Full-time

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple tec

Data Scientist

C&G Consulting Services

New York, New York, USA

Full-time

Hybrid - 3 days onsite Banking experience is a plus NO 3rd PARTIES Contract to hire Midtown Manhattan Data Scientist Job Responsibilities:Formulates and leads guided, multifaceted analytic studies against large volumes of data.Interprets and analyzes data using exploratory mathematic and statistical techniques based on the scientific method.Coordinates research and analytic activities utilizing various data points (unstructured and structured) and employ programming to clean, massage, and organ

Senior Data Architect

Brains Workgroup, Inc.

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

Big Data Developer

Capgemini America, Inc.

Jersey City, New Jersey, USA

Full-time

Position Title : Big Data Developer Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in software development, data engineering, and large-scale distributed systems. This role requires a deep understanding of big data technologies and the ability to lead and implement enterprise-scale

Data Engineer

Photon

Jersey City, New Jersey, USA

Full-time

Hi All, We have below opening for Data Engineer | Onsite - Jersey City, NJ, USA, if you are interested please share your updated resume to Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment w

AWS Data engineer ( Must be local to NJ/NY) - PP Number is must so no fake profile

EdgeAll

New York, New York, USA

Contract, Third Party

Candidate should be from NJ/NY location Data Engineer role Skills: Spark,Python, AWS and SQL

Senior Data Engineer - Databricks

Go2Group Inc.

New York, New York, USA

Contract

**Nosponsorshipavailable.Pleaseno3rdpartysubmissions** Ready to do some interesting, gratifying, and impactful work with Databricks? Seeking a Senior Data Engineer with strong Databricks expertise to join our Data Analytics & AI team. You ll partner with clients to build scalable cloud and data engineering solutions that deliver real business value. Key Points: 6-month contract-to-hire (Although FTE hires are the preference, this particular role due to current constraints and approvals for h

Lead Data Engineer with AWS and Snowflex

Marici Solutions

New York, New York, USA

Contract

Job Role: Lead Data Engineer (SQL) Location: NY&NJ (Onsite) Duration: Long Term Key Skills:Snowflake, SQL, Python, Spark, AWS- Glue,Big Data Concepts Responsibilities: Lead the design, development, and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Develop and maintain data pipelines, ensuring data quality, integrity, and security. Optimize data storage and retrieva

Senior Java Backend Developer

Brilliant Infotech Inc.

Jersey City, New Jersey, USA

Contract

Senior Java Backend DeveloperJersey City NJ Job Description:Sr. Java Developer with back end services development experience.Looking for a senior Java Developer with spring boot experienceAny knowledge of Spark will be added advantage

Big Data Engineer W2 CONTRACT ROLE

Zentek Infosoft Inc

New York, New York, USA

Contract

Hi,Greetings from Zentek Infosoft Inc. !!We have an immediate opening with one of our clients, please go through the job description and if you are interested kindly share your updated resume ASAP. A little bit about Zentek Infosoft: Zentek Infosoft Inc. have been providing Information Technology solutions, enterprise staffing and professional services for organizations in every industry, in the public and private sectors, and of every size, from start-ups to Fortune 500 firms over the last 6 ye

Big Data Architect

Photon

Jersey City, New Jersey, USA

Full-time

We are Photon, one of the world's largest Digital Platform Engineering company providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.I found your profile interesting and wanted to chat with you about a role in one of our programs as a 'Big Data Architect'. Please refer the below job description and let me know if you are interested in proceeding. Designation: Big Data ArchitectLocation:

Scala Developer, New York, NY(F2F)

Alphosoft Inc

New York, New York, USA

Contract, Third Party

Position: Scala Developer Location: New York, NY (In person interview required for second round) Duration: 12 Month Key Qualifications: Proficiency in Scala Experience with SQL and NoSQL databases (Teradata, PostgreSQL, MongoDB) Expertise in ETL pipeline development and data warehousing (Snowflake, Redshift) Familiarity with cloud infrastructure Azure Experience with Apache Spark, Kafka, Databricks, and Airflow These roles provide an excellent opportunity to learn, grow, and work with leading t

Scala Developer

Gurus Infotech, Inc.

New York, New York, USA

Contract, Third Party

Position: Scala DeveloperLocation: New York, NY (In person interview required for second round)Duration: 12 MonthIn-person interview required - locals preferred. Key Qualifications: Proficiency in Scala Experience with SQL and NoSQL databases (Teradata, PostgreSQL, MongoDB) Expertise in ETL pipeline development and data warehousing (Snowflake, Redshift) Familiarity with cloud infrastructure Azure Experience with Apache Spark, Kafka, Databricks, and Airflow These roles provide an excellent

VP, Architecture & Data Engineering

Horizon Media, Inc.

New York, New York, USA

Full-time

Who We Are Horizon Media, founded in 1989 by Bill Koenigsberg, is recognized as one of the most innovative marketing and advertising firms. We are headquartered in New York City, with offices in Los Angeles and Toronto. A leader in driving business solutions for marketers, Horizon is known for its highly personal approach to client service. Renowned for its incredible culture, Horizon is consistently named to all the prestigious annual Best Places to Work lists published by Fortune, AdAge, Crai