apache spark Jobs in new york, ny

Refine Results
561 - 580 of 593 Jobs

Data Engineer (Local to California with strong Data Modeling expertise)

Dilytics Inc

Remote

Third Party, Contract

Job Title: Data Engineer (Local to California with strong Data Modeling expertise) Client: State client Location: Sacramento, California (Remote Local candidates preferred) Job Description We are seeking an experienced Data Engineer to support a critical project for a state client. The role will primarily be remote, but candidates local to Sacramento, CA will be given strong preference. Minimum Qualifications (MSQs): 1. Must have a minimum of eight (8) years of experience in designing scalable

Engagement Manager (PySpark Data and Solution Architect)

ClifyX

Remote

Full-time

ClifyX group is an award winning IT Consultancy formed in 1998. Our Mission is to provide our clients with Optimal Technology solutions that are effective and within budgets. We specialize in helping Organizations to review their strategic SOW Projects/Talent needs and implement high value and cost effective solutions to increase profitability and efficiency. Our consulting capabilities include expertise in Cloud, Artificial Intelligence, Data Analytics and compliance aspects of Cyber Security d

Senior Technical Specialist - Infor XA

HCL America Inc.

Remote or Hartford, Connecticut, USA

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 220,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. ( ) The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version

Kafka Developer

Magicforce

Remote

Contract

Skills: Kafka Connect, Kafka Streams, and ksqlDB,,Kafka architecture ,CI/CD, JAVA/JVM languages , AWS/Azure Must complete the Lead Confluent/Kafka Engineer Assessment Responsibilities: Architect and design scalable, fault-tolerant, and high-performance Kafka-based data streaming solutions. Lead technical design sessions and provide architectural guidance to junior engineers.Develop and maintain Confluent Platform components, including Kafka Connect, Kafka Streams, Flink, TableFlow and ksqlDB. Im

Data warehouse Architect

R Systems, Inc.

Remote

Full-time, Third Party

Job Title: Data Warehouse Architect Location: Sacramento, CA Job Type: Long Term Contract About R Systems: R Systems is a global leader in technology and analytics services, delivering innovative solutions to drive digital transformation across industries like Telecom, Banking, Healthcare, and Public Services. With over 4,400 professionals in 25+ countries, we are committed to helping our clients achieve operational excellence and enhanced customer experiences. We are proud to be Great Place to

Global Content Specialist

Maxonic, Inc.

Remote

Contract

Maxonic maintains a close and long-term relationship with our direct client. In support of their needs, we are looking for a Global Content Specialist. Job Description: Job Title: Global Content Specialist Job Location: US (Remote) Work Schedule: Remote (EST Time Zone) Responsibilities: As a Global Content Specialist (Contract) on temporary assignment, you will help shape our unique position to forecast trends across fashion and beauty, food and drinks, lifestyle and more, as well as create uniq

Data Engineer _ Remote

Georgia IT

Remote

Contract

Job Title _ Data Engineer Location _ Remote Duration _ Contract Job Description We are seeking an experienced Senior Data Engineer with a strong background in healthcare data systems to join our team. This role demands a deep understanding of clinical data workflows, standards, and infrastructure. You will be responsible for building scalable, compliant, and high-performing data pipelines that support mission-critical healthcare applications. Key Responsibilities: Design, build, and maintain da

IDMC Architect

Enexus Global

California, USA

Contract

Role- IDMC Architect Remote Duration- 6 Months+ Tax Terms- W2 / C2C Skills: IDMC, Informatica Need a very Sr seasoned IDM resource 15 Yrs. We are seeking a highly skilled and experienced Informatica Architect to join our dynamic team. The ideal candidate will have a strong background in Informatica, Informatica Data Management Cloud (IDMC), and Collibra to design, develop, and implement robust data integration, governance, and management solutions. This role requires an individual who can

Data Solutions Architecture

Fusion Global Solutions

Remote

Contract, Third Party

Job Responsibilities Lead technical design and implementation of Palantir Foundry use cases Cross-train into Snowflake + Informatica implementation as needed Ensure best practices are followed for performance tuning, security and data governance Build awesome big data products within a fun team where culture is the foundation for success Lead and mentor the development team in a hands-on way Provide technical feasibility assessment while collaborating with Product Owner and Design team to

Senior Big Data Engineer

ProHire Solution

Remote

Full-time

Job Location: 100% remote (USA or Canada) Job Summary: We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and bui

Lead Confluent/Kafka Engineer

Dew Softech Inc

Remote or Pittsburgh, Pennsylvania, USA

Full-time, Part-time, Third Party, Contract

Lead Confluent/Kafka Engineer Location: Remote Position Type: Contract to Hire Job Description: Architect and design scalable, fault-tolerant, and high-performance Kafka-based data streaming solutions Lead technical design sessions and provide architectural guidance to junior engineers Develop and maintain Confluent Platform components, including Kafka Connect, Kafka Streams, Flink, TableFlow and ksqlDB Implement and manage monitoring and alerting systems for the Kafka cluster Lead troubleshoot

Looking for a IDMC Architect

SRS Consulting Inc

Remote

Third Party, Contract

Hello Associate, Hope you are doing great, Below positions is with Direct Client, Please share resumes Looking for a IDMC Architect 8 Months+ Remote Position Need a very Sr seasoned IDM resource 15 Yrs. sample resume attached We are seeking a highly skilled and experienced Informatica Architect to join our dynamic team. The ideal candidate will have a strong background in Informatica, Informatica Data Management Cloud (IDMC), and Collibra to design, develop, and implement robust data integratio

Software Engineer MLOps/Databricks

Sunrise Systems, Inc.

Remote

Contract

Our client, a leading apparel and sporting goods manufacturing company, is looking for a Software Engineer MLOps/Databricks. This is for an initial duration of 15 months and is a REMOTE job. Must be able to work PST Hours Job Type: Contract (Candidates must be able to work on W2 without VISA sponsorship) Must have: Strong Python skills a must What you ll do Build cloud infrastructure for machine learning following the MLOps modelDesign and implement public and internal APIsDesign event and stre

Sr Azure Data Engineer

Zealogics

Remote

Contract

Responsibilities: Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges. Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the da

Senior Laboratory Informatics Manager

Smart Synergies

Remote

Contract

100% REMOTE Job Overview: We are seeking a highly skilled and experienced Senior Laboratory Informatics Manager to lead our data science initiatives within the Translational Informatics department. This role requires a unique blend of laboratory expertise and advanced data science skills to build and manage robust data pipelines, ensure compliance with laboratory Standard Operating Procedures (SOPs), leverage Amazon Web Services (AWS) for data management, and effectively collaborate with product

Lead Data Engineer

Fusion Global Solutions

Remote

Contract

Lead Data Engineer Remote Local to Bay Area Need Min 12+Years experience, Palantir Foundry exp is Mandatory, As an Expert Tech Lead, you will lead data product delivery teams on our Palantir Foundry data platform, and may be expected to branch out into our other key platforms, Snowflake and Informatica. As a team leader, you will be responsible for bringing to life the vision of our business teams, driving requirements discussions, architecture, and code. You will lead technical design and imple

Data Architect With Canonical Modeling

Bahwan CyberTek Inc.

Remote

Contract

Job Title: Data Architect With Canonical Modeling Location: Remote (PST Hours) Duration: 3+ months Pay Rate: $75/- Hr. on C2C Note: Candidate needs to use his own laptop. Key Skills: Data Vault, Canonical Modeling and Databricks. Position Overview: As a Data Solution Engineer/Architect Advanced Analytics within our professional services practice, you will lead the design and delivery of cloud-native analytics architectures that solve complex data challenges for enterprise clients. This is a hi

Online Trainer Data Analyst Program

Brilliant Infotech Inc.

Remote

Full-time

Job Title: Online Trainer Data Analyst Program Company: Brilliant Academe Inc. Location: Remote (Edison, NJ & Noida, India) Employment Type: Part-Time / Contract Job Description: Brilliant Academe Inc., a premier IT training company, is seeking an experienced Online Trainer Data Analyst Program to equip students with the skills needed for certification programs through a 6-8 weeks Training spread across 40-60 hours. The trainer will provide structured instruction, hands-on assignments, and guide

Machine Learning AI Engineer

Buxton Consulting

Remote

Contract

Machine Learning AI Engineer Remote as per time of PST Time Zone 12+ Months Must Haves- Strong project experience in Machine Learning, Big Data, NLP, Deep Learning, RDBMS is must. Strong project experience with Amazon Web Services and Cloudera Data Platform is must. 4-5 experience building data pipelines using Python, MLLib, PyTorch, TensorFlow, Numpy/Scipy/Pandas, Spark, Hive, 4-5 years of programming experience in AWS, Linux and Data Science notebooks is must. Strong experience with REST API d

Online Trainer Data Science (AI, ML, DL)

Brilliant Infotech Inc.

Remote

Full-time

Job Title: Online Trainer Data Science (AI, ML, DL) Company: Brilliant Academe Inc. Location: Remote (Edison, NJ & Noida, India) Employment Type: Part-Time / Contract Job Description: Brilliant Academe Inc., a leading IT training company, is seeking an experienced Online Trainer Data Science (AI, ML, DL) to guide students through an in-depth certification program. The trainer will provide structured learning, hands-on assignments, and oversee a 2-3 week capstone project to reinforce key skills a