apache spark Jobs in new york, ny

1 - 20 of 416 Jobs

spark developerJob Title - spark developer

Rivi Consulting GroupCompany Name - Rivi Consulting Group

•

New York, New York, USA

Contract

Responsibilities will include: Understand and implement tactical or strategic solution for a given business problem Discussion with stakeholders on business needs and technology requirements. Define and derive the strategic solutions as well as identify tactical solutions when necessary. Write technical design & other solution documents per Agile (SCRUM) standards. Perform data analysis to aid development work and other business needs. Perform unit testing of the developed code leveraging

Spark ArchitectJob Title - Spark Architect

DCE Infosec LLCCompany Name - DCE Infosec LLC

•

Remote

Full-time

**No Employer **Must have 15 to 20+ years of experience Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Job DescriptionHandson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance, Data Quality, Good understanding of data oper

Integration Lead (IICS, Spark, Azure Data Lake)Job Title - Integration Lead (IICS, Spark, Azure Data Lake)

Ztek ConsultingCompany Name - Ztek Consulting

•

Remote

Full-time

Note: This is a fulltime and remote opportunity. Role: Integration Lead (IICS, Spark, Azure Data Lake) Work location: Remote Job Description 10+ years of experience in Informatica ETL Design and Architecture, Data Analysis & Data ManagementDemonstrated expertise in designing and implementing data architecture solutions using Informatica Cloud and AzureImplemented an Informatica based ETL solution fulfilling stringent performance requirementsExperience in designing and implementing ETL processe

Senior java developer with Spark - VP - TAMPAJob Title - Senior java developer with Spark - VP - TAMPA

CitiCompany Name - Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi

Big Data/Spark Principal ArchitectJob Title - Big Data/Spark Principal Architect

AIT Global, Inc.Company Name - AIT Global, Inc.

•

Full-time

Job Title: Big Data/Spark Principal Architect Location: Remote Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Years Of Experience15 to 20 Years Job Description: Hands on with Spark (data frame), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance,

Core Java Developer, Spark, SQL, Algorithms, Data Structures, Python/Shell, Junit/BDD, NYC 12 monthsJob Title - Core Java Developer, Spark, SQL, Algorithms, Data Structures, Python/Shell, Junit/BDD, NYC 12 months

Zen & ArtCompany Name - Zen & Art

•

New York, New York, USA

Third Party, Contract

Job Id: 3374 L4 Duration: 12 Months Location: NYC Title: Core Java Developer, Spark, SQL, Algorithms, Data Structures, Python/Shell, Junit/BDD, NYC 12 months Top Skills : JAVA + SPARK, Spark Core, Spark SQL, Stored procedure, Data models, writing SQL queries, Microservices, Rest API, Multi Threading, Data Structures , Algorithms Job Description below Market Risk Technology is seeking a strong senior application developer with experience in developing distributed systems, capable of proces

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTEJob Title - Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTE

Provish ConsultingCompany Name - Provish Consulting

•

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: 100% REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candid

Senior Data ArchitectJob Title - Senior Data Architect

Brains Workgroup, Inc.Company Name - Brains Workgroup, Inc.

•

New York, New York, USA

Full-time

Our client, a major bank in New York City, is looking for Senior Data Architect (Director Level). 2/3 days on-site in NYC office. This is a permanent FT career opportunity, Director - Level position with base salary range 220K-275K DOE, plus ~20-25% bonus and great benefits package. Senior Data ArchitectPOSITION SUMMARY: Seeking a highly experienced and innovative Senior Data Architect to join our Banking Technology team. This role is pivotal in designing, implementing, and managing data archite

Data ScientistJob Title - Data Scientist

C&G Consulting ServicesCompany Name - C&G Consulting Services

•

New York, New York, USA

Full-time

Hybrid - 3 days onsite Banking experience is a plus NO 3rd PARTIES Contract to hire Midtown Manhattan Data Scientist Job Responsibilities:Formulates and leads guided, multifaceted analytic studies against large volumes of data.Interprets and analyzes data using exploratory mathematic and statistical techniques based on the scientific method.Coordinates research and analytic activities utilizing various data points (unstructured and structured) and employ programming to clean, massage, and organ

Hadoop DeveloperJob Title - Hadoop Developer

Innova Solutions, IncCompany Name - Innova Solutions, Inc

•

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for Hadoop Developer Position type: Contract Duration: Long Term Location: Jersey City, NJ/Chicago, IL/Addison, TX (Hybrid 3 Days Onsite) As a Hadoop Developer, you will: Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml Experience working with SPARK Structured steaming Experience working with H

Data EngineerJob Title - Data Engineer

PhotonCompany Name - Photon

•

Jersey City, New Jersey, USA

Full-time

Hi All, We have below opening for Data Engineer | Onsite - Jersey City, NJ, USA, if you are interested please share your updated resume to Responsibilities Big Data - Spark, Hive, Java, CDP, 6 Years + with 3 Years of Dev experience on Big DataAnalyze data requirements and identify disparate data sources required for consolidation and distribution. Document functional specifications and coordinate delivery of the same with technology team. Review logical and conceptual data models in alignment w

AWS Data engineer ( Must be local to NJ/NY) - PP Number is must so no fake profileJob Title - AWS Data engineer ( Must be local to NJ/NY) - PP Number is must so no fake profile

EdgeAllCompany Name - EdgeAll

•

New York, New York, USA

Contract, Third Party

Candidate should be from NJ/NY location Data Engineer role Skills: Spark,Python, AWS and SQL

Senior Data Engineer - DatabricksJob Title - Senior Data Engineer - Databricks

Go2Group Inc.Company Name - Go2Group Inc.

•

New York, New York, USA

Contract

**Nosponsorshipavailable.Pleaseno3rdpartysubmissions** Ready to do some interesting, gratifying, and impactful work with Databricks? Seeking a Senior Data Engineer with strong Databricks expertise to join our Data Analytics & AI team. You ll partner with clients to build scalable cloud and data engineering solutions that deliver real business value. Key Points: 6-month contract-to-hire (Although FTE hires are the preference, this particular role due to current constraints and approvals for h

Lead Data Engineer with AWS and SnowflexJob Title - Lead Data Engineer with AWS and Snowflex

Marici SolutionsCompany Name - Marici Solutions

•

New York, New York, USA

Contract

Job Role: Lead Data Engineer (SQL) Location: NY&NJ (Onsite) Duration: Long Term Key Skills:Snowflake, SQL, Python, Spark, AWS- Glue,Big Data Concepts Responsibilities: Lead the design, development, and implementation of data solutions using AWS and Snowflake. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Develop and maintain data pipelines, ensuring data quality, integrity, and security. Optimize data storage and retrieva

Senior Java Backend DeveloperJob Title - Senior Java Backend Developer

Brilliant Infotech Inc.Company Name - Brilliant Infotech Inc.

•

Jersey City, New Jersey, USA

Contract

Senior Java Backend DeveloperJersey City NJ Job Description:Sr. Java Developer with back end services development experience.Looking for a senior Java Developer with spring boot experienceAny knowledge of Spark will be added advantage

Big Data Engineer W2 CONTRACT ROLEJob Title - Big Data Engineer W2 CONTRACT ROLE

Zentek Infosoft IncCompany Name - Zentek Infosoft Inc

•

New York, New York, USA

Contract

Hi,Greetings from Zentek Infosoft Inc. !!We have an immediate opening with one of our clients, please go through the job description and if you are interested kindly share your updated resume ASAP. A little bit about Zentek Infosoft: Zentek Infosoft Inc. have been providing Information Technology solutions, enterprise staffing and professional services for organizations in every industry, in the public and private sectors, and of every size, from start-ups to Fortune 500 firms over the last 6 ye

Big Data ArchitectJob Title - Big Data Architect

PhotonCompany Name - Photon

•

Jersey City, New Jersey, USA

Full-time

We are Photon, one of the world's largest Digital Platform Engineering company providing a combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We work with 40% of the Fortune 100 companies.I found your profile interesting and wanted to chat with you about a role in one of our programs as a 'Big Data Architect'. Please refer the below job description and let me know if you are interested in proceeding. Designation: Big Data ArchitectLocation:

Scala Developer, New York, NY(F2F)Job Title - Scala Developer, New York, NY(F2F)

Alphosoft IncCompany Name - Alphosoft Inc

•

New York, New York, USA

Contract, Third Party

Position: Scala Developer Location: New York, NY (In person interview required for second round) Duration: 12 Month Key Qualifications: Proficiency in Scala Experience with SQL and NoSQL databases (Teradata, PostgreSQL, MongoDB) Expertise in ETL pipeline development and data warehousing (Snowflake, Redshift) Familiarity with cloud infrastructure Azure Experience with Apache Spark, Kafka, Databricks, and Airflow These roles provide an excellent opportunity to learn, grow, and work with leading t

Scala DeveloperJob Title - Scala Developer

Gurus Infotech, Inc.Company Name - Gurus Infotech, Inc.

•

New York, New York, USA

Contract, Third Party

Position: Scala DeveloperLocation: New York, NY (In person interview required for second round)Duration: 12 MonthIn-person interview required - locals preferred. Key Qualifications: Proficiency in Scala Experience with SQL and NoSQL databases (Teradata, PostgreSQL, MongoDB) Expertise in ETL pipeline development and data warehousing (Snowflake, Redshift) Familiarity with cloud infrastructure Azure Experience with Apache Spark, Kafka, Databricks, and Airflow These roles provide an excellent

Data ArchitectJob Title - Data Architect

Xyant Services, Inc.Company Name - Xyant Services, Inc.

•

Jersey City, New Jersey, USA

Contract

Title - Data Architect with MS Fabric Location - Hybrid (New Jersey, NJ) Contract Job Description: Minimum 5+ years experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Data Bricks etc. Azure experience is preferred over other cloud platforms.Minimum 12 + years of proven experience with SQL, schema design and dimensional data modelling.Solid knowledge of data warehouse best practices, development standards and methodologies.Experience wit