Python Pyspark Jobs in New York

Refine Results
1 - 20 of 93 Jobs

DATA Engineer with Snowflake, PySpark, SQL, Python

iPivot, LLC

•

Jersey City, New Jersey, USA

Contract

Job Title: Data Engineer Snowflake, Python, SQL, PySpark Location: Jersey City, NJ Job Type: Long-term Contract Job Summary: We are looking for a skilled Data Engineer with hands-on experience in Snowflake, Python, SQL, and PySpark to join our data team. You will be responsible for building and maintaining scalable data pipelines, optimizing data flow, and integrating diverse data sources into our data platforms. This role is ideal for someone passionate about data, performance tuning, and ena
Easy Apply
Posted 23 days ago | Updated 6 days ago

Senior Data Engineer Healthcare Domain

TekLeaders, Inc

•

Remote or New York, New York, USA

Full-time, Part-time, Contract, Third Party

Position Details Requirement Creq TBD No of Positions 1 Role Senior Data Engineer Healthcare Domain Client C2H Location NYC, NY (Remote) Type of Hire - Contract/ C2H Rate (Max) W2 OR 1099 Duration Long-Term Number of Interviews L1+HR+Client In person interviews Yes/No No Client Interview Yes/No Yes No of submission (example not more than 3 resumes) 3 submissions Timeline for submission 2 hours Position requirements (Remote/ Hybrid/Fully onsite) Remote Job Description Senior Data Engineer Positio
Easy Apply
Posted 1 day ago | Updated moments ago

Sr. Data Engineer

Lorven Technologies, Inc.

•

New York, New York, USA

Third Party

Hi, Our client is looking for a Sr.Data Engineer for Contract project in New York, NY (Hybrid) below is the detailed requirement. If you are interested kindly share your updated resume to proceed further. Job Role: Sr. Data Engineer Location: New York, NY (Hybrid) Mode of Hiring: Long Term Job Description: The ideal candidate will have a strong background in data engineering and development, with expertise in various data skills and tools. The role involves working on complex data projects, c
Easy Apply
Posted 22 hours ago | Updated 17 hours ago

Sr PySpark developer

Photon

•

Jersey City, New Jersey, USA

Full-time

Description for Internal Candidates Requirements and Qualifications: 8+ years of relevant experience in the Data Engineering, ApacheSparkStrong proficiency in PySpark and Apache Spark.Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).Expertise in cloud platforms (AWS, Azure, or Google Cloud Platform).Proficiency in Python programming and data manipulation.Knowledge of ETL tools, data lakes, and data wareh
Easy Apply
Posted 9 days ago

Lead Palantir Foundry - Remote

Nava Software Solutions

•

Remote or Jersey City, New Jersey, USA

Contract, Third Party

NAVA Software solutions is looking for a Technical Lead, Palantir Foundry Details: Technical Lead, Palantir Foundry-Predictive AI Location: : Remote | Central / East Coast Hours Duration : 12+ months Description: Technical Lead at Client work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate data solutions with external systems containing the data. Key Responsibilities Include: Evaluate and inform Product Owner and other
Easy Apply
Posted 1 day ago | Updated 21 hours ago

Data Engineer

Avenues International, Inc.

•

New York, New York, USA

Contract

W2 Role Job Title: Data Engineer Type (Contract, Contract to Hire, Perm) : 12 +months Location: New York City, New York or Phoenix Arizona (Either of 2 locations(Onsite) Note : 2 Positions are there 1. More core data engineering expertise- building data pipeline using PySpark, BigQuery, Python 2 .Needs experience working on real time pipelines, exposed to API's JD: We are looking for a highly skilled Engineer with a solid experience of building Bigdata, Google Cloud Platform Cloud based real t
Easy Apply
Posted 2 days ago

Azure Data Engineer - Weehawken, NJ (ONSITE)

iPeople Infosystems LLC

•

Weehawken Township, New Jersey, USA

Contract

Azure Data Engineer :- hands-on skill on pyspark/python, Azure Databricks, Data Warehouse and some exposure to financing domain. Must Have: DatabricksPythonpysparkPL/SQLOracle or equivalent databaseUnix shell/perl scriptingJava - OO Concepts or any other equivalent language.Nice to have : Prior Financial / banking IT experience (Knowledge of the products) MS SSIS/SSAS
Easy Apply
Posted 2 days ago

Pyspark Development Lead

Capgemini America, Inc.

•

Jersey City, New Jersey, USA

Full-time

Position Title : PySpark Development Lead Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description: 8 + years hands-on experience as a PySpark developmentStrong programming skills in Hive/Python with minimum 5 Years of Experience.Familiarity with big data processing tools and techniquesExperience with the Hadoop ecosystemGood understanding of distributed systemsShould be familiar with Data warehouse concepts.Experience with streaming data
Easy Apply
Posted 12 hours ago

Senior Data Engineer (Snowflake/Python) (NO H1B)

Syeta Inc

•

Woodbridge Township, New Jersey, USA

Full-time

REQUIREMENT: POSITION: Senior Data Engineer (Snowflake/Python) LOCATION : Iselin, NJ NOTE : VISA (NO H1B) JOB DESCRIPTION: Proven 13+ years of experience in Snowflake data warehousing DevelopmentExpert in Python & Pyspark for data processing and automation.Strong expertise in Strong SQL and SQL query optimization skillsStrong knowledge of data warehousing concepts and best practices.Familiarity with Snowflake's architecture, features, and best practices.Experience with data modeling, ETL develop
Easy Apply
Posted 24 days ago

Integration Engineer

Excelque, Inc

•

New York, New York, USA

Contract

We are urgently hiring for Integration Engineer - United States. Title: Integration Engineer Location: Metropark, NJ Experience: 10+ Years Duration: Long Term If you are interested in this position, please share your updated resume to Job Description: Title: Integration Engineer - specifically with Astronomer Airflow experience This position is for an Integration engineer with a background in Airflow, Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for
Easy Apply
Posted 9 days ago

Integration Engineer

PeopleNTech

•

Woodbridge Township, New Jersey, USA

Contract, Third Party

Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.Design, develop, and deploy Spark program in data bricks environment to process and analyse large volumes of data.Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.Proficient in developing programs in Python and SQLExperience with Data warehouse Dimensional data modelling.Working with even
Easy Apply
Posted 8 days ago

Azure Data Engineer

Swanktek

•

Jersey City, New Jersey, USA

Contract

Role: Azure Data Engineer Location: Iselin, NJ 3 Days Hybrid from Day 1 Must Have: SnowflakeSQLPythonADFAzure Data BricksPySparkData Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize data pipelines for efficient dat
Easy Apply
Posted 2 days ago

Data Scientist

IDR Inc.

•

Jersey City, New Jersey, USA

Full-time

Data Scientist Ongoing contract (Client maintains right to hire after 3 months though rarely exercises this right)Location: Jersey City, New Jersey C2C Pay Rate: $90.00Job Summary We are seeking a seasoned Senior Data Scientist with 15+ years of experience in developing and deploying machine learning solutions. The ideal candidate should have hands-on expertise in MLOps (at least two end-to-end production deployments), solution architecture, and experience with one major cloud platform (AWS, Az
Posted 1 day ago | Updated 1 hour ago

AWS Data Engineer (Entry Level) in NJ & TX

Brilliant Infotech Inc.

•

Edison, New Jersey, USA

Full-time

Role: AWS Data Engineer (Entry Level) Location: NJ, TX (5 days Onsite) Exp: 1-3 Years preferable Primary Skills: AWS, Python, PySpark, SQL Secondary Skills: Knowledge of DevOps/Data Science & ML Description: 1-3 years of experience programming in SQL, Python and relevant packages like Pandas, and with Apache SparkExperience writing clean code that utilizes object-oriented paradigms when appropriateA strong foundation in data modeling, architecture and data warehousingExperience working in a CI/
Easy Apply
Posted 60+ days ago | Updated 23 hours ago

Member of Technical Staff - Machine Learning Engineer

Microsoft Corporation

•

New York, New York, USA

Full-time

Overview As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad - to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It's also inclusive: we aim to make AI accessible to all - consumers, businesses, developers - so that everyone can realize its benefits. Help us push the front
Posted 28 days ago | Updated 3 hours ago

Palantir Foundry Data Engineer

PeakIT

•

Remote

Contract

12 Months+ Key things Python, Pyspark, Palantir Foundry Palantir Found experience a must. Remote Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platformIdentify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater sc
Easy Apply
Posted 6 days ago

AWS Data Architect

Talent Glide

•

Remote

Contract

Position - AWS Data ArchitectDuration 12monthLocation - Remote Must skills - AWS Redshift, AWS Glu, AWS Lake formation, PySpark Key Responsibilities: Design and implement end-to-end cloud-native data architectures on AWS.Build and optimize data lakes, data warehouses, and analytics platforms using AWS services.Architect and manage data pipelines with AWS Glue, Apache Airflow, and PySpark.Implement advanced data formats and technologies including Apache Iceberg and Delta Lake.Strong programming s
Easy Apply
Posted 15 hours ago

Senior Data Engineer

Sensiple Inc.

•

Remote

Contract

Sensiple Inc is a New Jersey corporation with over two decades of expertise in technology-driven solutions specializing in Customer Experience, Contact Center Solutions, Digital Transformation, Cloud Computing & Independent Testing. With an expert team that has enriched experience in executing & developing sustainable IT strategies in Healthcare, Technology, Retail, Logistics, Education, Telecommunications, Government and Media, we help our diverse customers to envision the future. By developing
Easy Apply
Posted 2 days ago | Updated 23 hours ago

Java/Google Cloud Platform Engineer

Global Soft Systems

•

Remote or US

Contract

Java/Google Cloud Platform Engineer Remote Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients Java/Google Cloud Platform Engineer - Prime Therapeutics - Remote - Contract to Hire Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients A ton of data coming from a variety of sources (100+) Legacy app built on access and .Net and was never set up for enterprise support o Will be maintaine
Easy Apply
Posted 14 days ago | Updated 6 hours ago

Data Scientist

City of New York

•

New York, New York, USA

Full-time

Company Description Job Description *IN ORDER TO BE CONSIDERED FOR THIS POSITION CANDIDATE MUST EITHER BE SERVING PERMANENTLY IN THE ECONOMIST TITLE, REACHABLE ON THE CIVIL SERVICE LIST, OR ELIGIBLE UNDER THE 55A PROGRAM.* Transportation Planning and Management (TPM) is responsible for the safe, efficient, and environmentally responsible movement of people and goods on the City's streets, supporting the larger goals of economic and social vitality for people living, working, and doing busines
Posted 29 days ago | Updated 3 hours ago