apache spark Jobs in new york, ny

Refine Results
541 - 560 of 593 Jobs

Full stack Engineer

Prism IT Corp

•

Remote

Full-time

Job Description: About the Role The Relevance Team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make Explore, shape, and develop new product experiences alongside engineers and product managers, from ideation to implementation Develop prototypes to iteratively validate ideas that push technical capabilities Integrate AI capabilities into future products Your Expertise 3+ years of frontend software development ex
Easy Apply
Posted 39 days ago | Updated 26 days ago

Azure Data Engineer Consultant

Korn Ferry

•

Remote

Contract

Job Summary: We are seeking a highly skilled Azure Data Engineering Consultant to join our data team and drive the development and optimization of enterprise-grade data solutions. The ideal candidate will have extensive experience in enterprise ETL, strong SQL skills, and a solid background in Azure-based data engineering. Proficiency in either Python or Spark SQL is essential to succeed in this role. Key Responsibilities: Design, develop, and optimize scalable ETL pipelines and data workflows
Easy Apply
Posted 19 days ago | Updated 3 hours ago

Data Engineer

Dahl Consulting

•

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,
Easy Apply
Posted 12 days ago

Palantir Engineer

CX Data Labs Pvt Ltd

•

INT, USA

Full-time, Contract

Palantir Engineer South America Fulltime/Contract Key Responsibilities: Design, develop, and maintain data pipelines and ETL workflows within Palantir Foundry and/or Gotham. Collaborate with data scientists, analysts, and stakeholders to understand data needs and deliver scalable solutions. Integrate and transform data from various sources into usable formats using best practices in data engineering. Optimize performance and reliability of data pipelines and workflows. Contribute to data modell
Posted 7 days ago | Updated 6 hours ago

Google Cloud Platform Architect

Estuate Inc.

•

Remote

Third Party, Contract

Hi, We have a very urgent requirement for Google Cloud Platform Architect. Please let me know if you or someone you know is interested. Please see the job details below. Position: Google Cloud Platform Architect Location: Remote Deep experienced data engineer/architect. Review installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by . 4-5 weeks assessment and analysis/recommendations are the expected
Easy Apply
Posted 60+ days ago | Updated 5 days ago

Palantir Foundry Developer / Data Engineer.

GreyMatter Solutions

•

Remote

Contract

Hello All, Hope you are doing well Looking for Palantir Foundry Developer / Data Engineer Location: [Insert Location or Remote] Experience: 3+ years (min. 1 year in Palantir Foundry) Type: [Full-time / Contract / Remote] Summary: Looking for a professional with hands-on experience in Palantir Foundry, used for data integration and analysis. The role involves building scalable data pipelines, transforming data from multiple sources, and delivering actionable insights. Must-Have Skills: Strong exp
Easy Apply
Posted 28 days ago | Updated 8 hours ago

Machine Learning Engineer (Infrastructure)

Photon

•

Remote

Full-time

Who are we? Photon has emerged as one of the world s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. For a brief 1 minute video about us, you can check Machine Learning Engineer (Infrastructure) Mountain View, CA Description: Experience in Machine Learning engineer or Infrastructure roles, with a focus on Machine Learning infras
Easy Apply
Posted 28 days ago | Updated 18 days ago

Cloud Data Platform Solution Architect - 100% Remote

Floga technologies

•

Remote

Contract

Role: Cloud Data Platform Solution Architect Location: 100% Remote Duration: Long Term Client Location: On Shore, US Mode of work Client or office environment / may work remotely., Occasional evening and weekend work. Work Time Zone: EST or CST About the job Job Summary: We re looking for a Solution Architect to join our product development team to drive a cloud-based data platform architecture that will power BI and advanced analytics.You will have a direct impact on the design, architecture,
Easy Apply
Posted 4 hours ago

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

•

Remote

Contract, Third Party

Job Title: Solution Architect with strong Kafka exp Location: 100% Remote Duration: 6 Months CTH Required Skills: Build API's from scrach is most important.API Gateway buildingManage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, R
Easy Apply
Posted 38 days ago | Updated 6 hours ago

Data Warehouse Architect

Key Business Solutions, Inc.

•

Remote

Third Party, Contract

Data Warehouse Architect Remote 12+ Months Must have a minimum of eight (8) years of experience in dimensional modeling, data vault, and normalized/denormalized schema design with the ability to architect data models that translate business requirements into scalable technical solutions, developing documentation and architectural diagrams, and leading data projects from end-to-end. Must have a minimum of eight (8) years of experience performing data partitioning, clustering, indexing, and query
Easy Apply
Posted 3 days ago | Updated 9 hours ago

Data & BI Analytics Lead - P&C Insurance

Acunor Infotech

•

New Jersey, USA

Full-time

Ideal Profile: Education: Bachelor's or Master's degree in Data Science, Statistics, Mathematics, Economics, Computer Science, or a related field. An advanced degree is preferred. Experience: 10 - 15 years of experience in data analytics, with a strong focus on insurance analytics. Expertise in the Property & Casualty (P&C) domain is strongly preferred. Technical Skills: Strong in SQL, Python, Spark, and data pipeline architecture Deep understanding of cloud platforms (AWS, Azure, or Google Cl
Easy Apply
Posted 18 days ago | Updated 20 hours ago

Data Scientist

BEAT LLC

•

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati
Easy Apply
Posted 41 days ago | Updated 20 days ago

UiPath Developer

HCL America Inc.

•

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 220,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. ( ) The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version
Easy Apply
Posted 3 days ago

Data Engineer W/Healthcare EXP

Key Business Solutions, Inc.

•

Remote

Contract, Third Party

Data Engineer W/Healthcare EXP Remote 12 Months Need 3 references from three different clients Required: Must have a minimum of eight (8) years of experience in designing scalable ETL/ELT workflows using tools like Informatics, Apache Airflow, Databricks SSIS, Azure Data Factory or dbt.Must have a minimum of six (6) years of experience of building and managing data pipelines in AWS (Glue, Redshift), Azure (ADF, Synapse), Google Cloud Platform (Dataflow, Big Query) or hybrid environments using Sp
Easy Apply
Posted 1 day ago

Lead Data Engineer with Snowlfake, AWS, Python, SQL

Marici Solutions

•

Remote

Contract

Position: Lead Data Engineer Location: Jersey City, NJ (Remote) Duration: Long Term Client: EXL Must Haves: Snowflake, SQL, Python, Spark, AWS- Glue,Big Data Concepts. Stack Holder Management Must have lead the design, development and implementation of data solutions using AWS and Snowflake Must have: 10+ years of relevant experienceinData Engineeringand delivery. 10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations. Strong experience with SQL, python and
Easy Apply
Posted 3 days ago

Confluent/Kafka Engineer

SGS Consulting

•

Remote

Full-time

Job Title Associate Confluent/Kafka Engineer Location Remote. Duration Contractual 06+ months ( Contact to hire opportunity) Note: Must complete the Associate Confluent/Kafka Engineer Assessment Responsibilities and Duties: Implement and maintain Kafka-based data streaming solutions based on provided designs and specifications.Contribute to the development of new features and improvements to the existing platform.Develop and maintain integrations with various applications and systems using Kafka
Easy Apply
Posted 13 days ago | Updated 12 days ago

Full Stack (Java/Python + React) - Remote - Fulltime

Lorven Technologies, Inc.

•

US

Full-time

Job Title:Full Stack (Java/Python + React) Location: Remote Employment Type: Fulltime Job description: UX prototyping contractors The Relevance team builds machine learning models to power product experiences and item rankings across various surfaces. The Difference You Will Make: Explore, shape, and develop new product experiences alongside engineers and product managers from the relevance team; from ideation to implementation Develop prototypes to iteratively validate ideas that push th
Easy Apply
Posted 45 days ago | Updated 7 hours ago

Azure Data Engineer (Need Python Experience)

Spar Information Systems

•

US

Full-time, Part-time, Contract, Third Party

Hello Everyone, Hope you are doing good My name is Pavan and I work with SPAR Information System., I have a great opportunity for you, please find the job details below, if you are interested in applying please send me your updated resume and best time for you to discuss about this opportunity in details. Role: Data Engineer Location: Remote Duration: Long term contract JD Experienced SR Data Engineer: 8+ years of experience working with data infrastructure, ETL processes, and large-scale data
Easy Apply
Posted 7 days ago | Updated 6 hours ago

Confluent/Kafka Engineer

Dew Softech Inc

•

Remote or Pittsburgh, Pennsylvania, USA

Full-time, Part-time, Contract, Third Party

Confluent/Kafka Engineer Location : Remote Duration: 6 Months (CTH) Job Description We are looking for a Confluent/Kafka Engineer for a contract-to-hire opportunity that is fully remote. What You'll Do Implement and maintain Kafka-based data streaming solutions based on provided designs and specifications Contribute to the development of new features and improvements to the existing platform Develop and maintain integrations with various applications and systems using Kafka Connect Monitor a
Easy Apply
Posted 13 days ago | Updated moments ago

Azure Databricks Engineer

Rivago infotech inc

•

Remote

Full-time

Job Title: Azure Databricks Engineer (Unity Catalog) Remote Location: Remote (U.S. Based) Job Type: Full-Time Visa Status: Open to all visa types (H1B, etc.) Job Overview:We are seeking a highly skilled and experienced Azure Databricks Engineer with hands-on expertise in Unity Catalog to support the development and governance of our modern data platform. This is a fully remote role offering flexibility and the opportunity to work with cutting-edge cloud data technologies in a collaborative env
Easy Apply
Posted 3 days ago