big data Jobs in new york

Refine Results
401 - 420 of 499 Jobs

Principal, Software Engineer - Conversational AI

Walmart Inc.

•

Remote or Sunnyvale, California, USA

Full-time

Position Summary What you'll do Cortex Team is Walmarts core A.I. conversational platform, powering the vision of delivering the worlds best personal assistants to Walmarts customers, accessible via natural voice commands, text messages, rich UI interactions, and a mix of all of the above via multi-modal experiences. We believeconversationsare a natural and powerful user interface for interacting with technology and enable a richer customer experiences both online and in-store. We are building
Posted 60+ days ago | Updated 7 hours ago

Director, Data Services and AI

Kentro

•

US

Full-time

Description Thank you for considering IT Concepts dba Kentro, where innovation drives opportunity and collaboration leads to success. Our dynamic community of experts is fully committed to advancing our customers' missions, fostering professional growth, and making a positive impact on our communities. Our transition to Kentro in 2025 reflects a rich legacy built upon the foundation of IT Concepts. Rather than leaving ITC behind, we confidently embrace a future centered around the Core of More
Posted 60+ days ago | Updated 4 hours ago

Cloud Infrastructure Engineers-Azure-Evergreen

General Dynamics

•

District of Columbia, USA

Full-time

Type of Requisition: Pipeline Clearance Level Must Currently Possess: Secret Clearance Level Must Be Able to Obtain: Secret Public Trust/Other Required: None Job Family: Software Development Job Qualifications: Skills: Cloud Infrastructure, Extract Transform Load (ETL), Microsoft Azure, Microsoft Azure Databricks, Terraform (Software) Certifications: None Experience: 10 + years of related experience ship Required: No Job Description: Software Developer Expert Your Impact Own your oppor
Posted 24 days ago | Updated 7 hours ago

Senior Data Engineer

iSpace, Inc

•

Remote

Contract

JOB DETAILS: Title: Senior Data Engineer Location: Remote Work (Team is based out in Century City, CA and NYC, NY) Type: 06 -12 plus months contract (extendable) Job Description: Looking for Senior Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering team. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you. P
Easy Apply
Posted 60+ days ago | Updated 2 hours ago

Azure SQL Developer

iSpace, Inc

•

Remote

Full-time

JOB DETAILS: Title: Senior SQL Developer (with Azure Data Factory) Location: Remote, but must work PST hours (client is based out in Burbank, CA) Type: Direct Hire / Full Time Employee Job Description: Knowledge/Skills/Abilities: Expertise in ELT optimization, designing, coding, and tuning big data processes using Microsoft Azure Synapse or similar technologies.Experience with building data pipelines and analytics solution to stream and process datasets at low latencies.Knowledge of Data Eng
Easy Apply
Posted 60+ days ago | Updated 2 hours ago

Data Engineer - ETL, Spark hadoop and Funds background.

RIIM

•

Jersey City, New Jersey, USA

Full-time

Looking for Data Engineer having experience with ETL, Spark hadoop and Funds background. Jersey City, NJ - Hybrid ETL, spark hadoop as tech skills but needs someone from Funds background.Proficient in Hadoop, Python, Spark, SQL Unix and HiveBasic understanding of on Prem and Google Cloud Platform data securityHands on development experience on large ETL/ big data systems .Google Cloud Platform being a big plus
Easy Apply
Posted 14 hours ago

Google Cloud Platform Engineer

Aptino

•

Jersey City, New Jersey, USA

Third Party, Contract

Implement and control the flow of data to and from Google Cloud Platform Migrate on-premises workloads to Google Cloud Platform, hands on experience migrating data to the cloud. familiarity with the disciplines of enterprise software development such as configuration & release management, source code. Data engineering tools and technologies, including SQL, and Google Cloud Platform Experience with Big Query and Big Data technologies like Spark, Hadoop Exposure to any programming ( Java , .Net ,
Easy Apply
Posted 6 days ago | Updated 1 day ago

Kafka Admin

OJUS LLC

•

Jersey City, New Jersey, USA

Third Party, Contract

Job Title: Kafka Admin Location NJ, Delaware, Tampa FL Design and architect solutions using Confluent Kafka. Sound understanding of Big data concepts.Must have knowledge on securing Kafka using Kafka ACLs.Good to have knowledge of enablement of Kafka connectors.Must have experience with security in Confluent Kafka v5.* and above.Out-of-the-box thinking regarding technology solutions and in resolving technical issues for the team.Will be required to provide high-level technical support for automa
Easy Apply
Posted 12 days ago

KAFKA Admin

Ventures Unlimited

•

New York, New York, USA

Full-time

Must Have Technical/Functional Skills Designing, developing, and managing Kafka-based data pipelines. Working with other big data technologies such as Hadoop, Spark, and Storm. Monitoring and optimizing Kafka clusters. Troubleshooting Kafka related issues. Performing 3rd level administrator support for Kafka infrastructure. Maintaining the availability, performance and security of Kafka infrastructure. Creating and managing Kafka topics, producers, consumers, and Python-based Kafka consum
Easy Apply
Posted 14 days ago | Updated 8 days ago

Senior Azure Databricks Engineer- "Power BI experience is mandatory"

Dotcom Team, LLC

•

Jersey City, New Jersey, USA

Contract

Job Description: We are seeking a skilled Databricks Engineer with strong experience in Azure Databricks and Power BI to develop and optimize data pipelines, support analytics initiatives, and deliver high-impact dashboards. The ideal candidate will have hands-on experience with big data technologies and cloud-based data platforms. Key Responsibilities: Build, optimize, and maintain ETL pipelines using Azure Databricks (PySpark/Scala)Design and implement data models in Power BI and create visual
Easy Apply
Posted 7 hours ago

Onsite - Scala Developer - NYC (Onsite) - Lorven Technologies Inc

Lorven Technologies, Inc.

•

New York, New York, USA

Third Party

Hi, Our client is looking for an Scala Developer with a Contract project in NYC, NY below is the detailed requirement. Position: Scala Developer Location: NYC, NY (Onsite) Job Mode: Contract Mode of Interview: Face to Face interview must with Client Job Description: Scala developer that will be responsible for delivering a high quality code in a big data platform, Unit testing in automated test framework, automated DevOps release and documentation of technology solutions for transaction moni
Easy Apply
Posted 6 days ago | Updated moments ago

Snowflake Architect

ITBMS Inc.

•

New York, New York, USA

Contract, Third Party

Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink for secure connectivity. Deep understanding of Snowflake sharing capabilities, Listings (auto fulfillment), and Marketplace features. Hands-on experience with Snowflake cost management in multi-tena
Easy Apply
Posted 1 day ago

Data Engineer

Intraedge

•

New York, New York, USA

Contract, Third Party

Job Title: : Google Cloud Platform Data Engineer Location: NYC (Day 1 onsite Hybrid 3 days a week in office) Duration: Long Term Contract Job Description: Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (Google Cloud Platform, Azure, AWS). Google Cloud Platform certification will be very good to have. Strong Hands on experience with one or more programming languages ( Python or Java). Hands-on expertise with application design and software devel
Easy Apply
Posted 35 days ago | Updated 2 days ago

Strong Snowflake Architect with DBT(Data Built Tools) | Local to NYC or Florida

HAN IT Staffing Inc.

•

New York, New York, USA

Contract, Third Party

Job: Strong Snowflake Architect with DBT (Data Built Tools) Location: NYC or Lake Mary, FL Locals only Duration: Long Term Job Description: Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases.Experience with SAML and SCIM integrations for identity and access managementProficiency in configuring new Snowflake accounts and setting up PrivateLink for secure connectivity.Deep understanding of Snowflake sha
Easy Apply
Posted 2 days ago | Updated 6 hours ago

Snowflake Architect

Nam Info Inc

•

New York, New York, USA

Third Party, Contract

Snowflake Architect NYC, NY/ Lake Mary, FL 12 Months Mandatory Skills: Snowflake, DBT Experience in other ETL tools & RDBMS, SQL Python, Cloud Data Services, Spark, Big Data Description: Hands-on experience in Snowflake & related data platforms Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management Proficiency in configuring new Snowflake accounts and setting up PrivateLink fo
Easy Apply
Posted 1 day ago | Updated 2 hours ago

Java Full-Stack Developer with Azure / New York City, NY / Hybrid

Lorven Technologies, Inc.

•

New York, New York, USA

Third Party

Job Title: Java Full-Stack Developer with Azure Location: New York City, NY (Hybrid) Duration: 12 +months Experience: 10+ Years Responsibilities: Develop fullstack applications using Java (Spring Boot) and React.js with RESTful APIs. Build secure, scalable services and frontend components with clean, testable code. Design and manage ETL pipelines using Azure Data Factory, connecting to various data sources. Collaborate across teams to ensure seamless integration between UI, backend, and data
Easy Apply
Posted 12 days ago | Updated moments ago

Python Developer AI & Data Science

iPivot, LLC

•

Weehawken Township, New Jersey, USA

Contract

Job Title: Python Developer AI & Data Science Location: Weehawken, NJ Job Summary We are seeking a highly motivated and experienced Python Developer with a strong background in Artificial Intelligence, Machine Learning, and Data Science. You will work closely with data scientists, engineers, and product teams to build scalable AI-powered solutions, process large datasets, and deliver intelligent business insights. Key Responsibilities Design, develop, and deploy robust Python applications focuse
Easy Apply
Posted 1 day ago

Python Developer (BFS Domain)

Brilliant Infotech Inc.

•

Woodbridge Township, New Jersey, USA

Contract

Job Title: PySpark Developer (BFSI Domain) Location: Iselin, NJ Duration: 12+ Months Must Haves: (Python, SQL, Azure, Banking/Finance) Need only locals or tristate and recent Banking and Finance experience is MUST Requirements: Minimum of 9 years of experience in PySpark development. Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.). Prior experience in the banking, investment banking, or financial services sector is mandatory. Proficient in PySpark
Easy Apply
Posted 23 days ago | Updated 9 days ago

Azure Data Architect

Ventures Unlimited

•

Newark, New Jersey, USA

Full-time

Minimum 5+ years experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Microsoft Fabric etc.Azure experience is preferred over other cloud platforms.Minimum 12 + years of proven experience with SQL, schema design and dimensional data modelling.Solid knowledge of data warehouse best practices, development standards and methodologies.Experience with ETL/ELT tools like ADF, Azure, MS Fabric etc., and data warehousing technologies like Azure Sy
Easy Apply
Posted 14 days ago | Updated 8 days ago

Lead Databricks Architect

Nityo Infotech Corporation

•

Jersey City, New Jersey, USA

Contract, Third Party

Role : Lead Databricks Architect Location : Iselin NJ : Hybrid (2-3 Days) Local candidates only Exp level : 15 years+ Must have : Expert in Databricks , Pyspark , python, SQL JD: Strong knowledge on data bricks architecture and tools Have experience of task and wf jobs creations in data bricks. Deep understanding of distributed computing and how to use spark for data processing. SQL and pyspark : strong command over querying databases and proficiency in pyspark. Cloud platform: Preferred Azure
Easy Apply
Posted 5 days ago