python pyspark Jobs in new york

Refine Results
1 - 20 of 94 Jobs

Hiring for Python/Pyspark Developer - Remote

Feuji Inc

Remote

Contract

Hi, This is Rehan from Feuji. I have below requirement with one of our client and if you are comfortable with the Job Description kindly share your updated resume with contact details. PYTHON AND PYSPARK Developer Location :: USA- Remote These engineers will require a proficiency specifically in the following areas: Python/Pyspark, Java 17, Hadoop (Hive, Hue, Impala, Hbase), Drools experience, SQL Server 3+ years experience Should you be interested, please send me a copy of your resume in word

DATA Engineer with Snowflake, PySpark, SQL, Python

iPivot, LLC

Jersey City, New Jersey, USA

Contract

Job Title: Data Engineer Snowflake, Python, SQL, PySpark Location: Jersey City, NJ Job Type: Long-term Contract Job Summary: We are looking for a skilled Data Engineer with hands-on experience in Snowflake, Python, SQL, and PySpark to join our data team. You will be responsible for building and maintaining scalable data pipelines, optimizing data flow, and integrating diverse data sources into our data platforms. This role is ideal for someone passionate about data, performance tuning, and ena

Senior Data Engineer Healthcare Domain

TekLeaders, Inc

Remote or New York, New York, USA

Full-time, Part-time, Contract, Third Party

Position Details Requirement Creq TBD No of Positions 1 Role Senior Data Engineer Healthcare Domain Client C2H Location NYC, NY (Remote) Type of Hire - Contract/ C2H Rate (Max) W2 OR 1099 Duration Long-Term Number of Interviews L1+HR+Client In person interviews Yes/No No Client Interview Yes/No Yes No of submission (example not more than 3 resumes) 3 submissions Timeline for submission 2 hours Position requirements (Remote/ Hybrid/Fully onsite) Remote Job Description Senior Data Engineer Positio

Data Integration Engineer

FutureTech Consultants LLC

New York, New York, USA

Contract

Hi, Hope you are doing good, This is Rajeev from FutureTech Consultants, LLC and I have a job opening with our direct client. Please have a look at the below job description and let me know your interest. Please share me the latest copy of your resume. Role: Sr. Integration Engineer Location: NYC (HYBRID) Duration: Long Term Contract Hiring Manager Notes: Title will be Data Engineers but look for Apache Airflow integration experience. Ask them their expertise on Apache Airflow and if they have w

Sr PySpark developer

Photon

Jersey City, New Jersey, USA

Full-time

Description for Internal Candidates Requirements and Qualifications: 8+ years of relevant experience in the Data Engineering, ApacheSparkStrong proficiency in PySpark and Apache Spark.Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).Expertise in cloud platforms (AWS, Azure, or Google Cloud Platform).Proficiency in Python programming and data manipulation.Knowledge of ETL tools, data lakes, and data wareh

Lead Palantir Foundry - Remote

Nava Software Solutions

Remote or Jersey City, New Jersey, USA

Contract, Third Party

NAVA Software solutions is looking for a Technical Lead, Palantir Foundry Details: Technical Lead, Palantir Foundry-Predictive AI Location: : Remote | Central / East Coast Hours Duration : 12+ months Description: Technical Lead at Client work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate data solutions with external systems containing the data. Key Responsibilities Include: Evaluate and inform Product Owner and other

Data Engineer

Avenues International, Inc.

New York, New York, USA

Contract

W2 Role Job Title: Data Engineer Type (Contract, Contract to Hire, Perm) : 12 +months Location: New York City, New York or Phoenix Arizona (Either of 2 locations(Onsite) Note : 2 Positions are there 1. More core data engineering expertise- building data pipeline using PySpark, BigQuery, Python 2 .Needs experience working on real time pipelines, exposed to API's JD: We are looking for a highly skilled Engineer with a solid experience of building Bigdata, Google Cloud Platform Cloud based real t

Azure Data Engineer - Weehawken, NJ (ONSITE)

iPeople Infosystems LLC

Weehawken Township, New Jersey, USA

Contract

Azure Data Engineer :- hands-on skill on pyspark/python, Azure Databricks, Data Warehouse and some exposure to financing domain. Must Have: DatabricksPythonpysparkPL/SQLOracle or equivalent databaseUnix shell/perl scriptingJava - OO Concepts or any other equivalent language.Nice to have : Prior Financial / banking IT experience (Knowledge of the products) MS SSIS/SSAS

Pyspark Development Lead

Capgemini America, Inc.

Jersey City, New Jersey, USA

Full-time

Position Title : PySpark Development Lead Location : Jersey City, NJ (Hybrid) Experience : 8+ Years Employee Type : Full Time with Benefits Job Description: 8 + years hands-on experience as a PySpark developmentStrong programming skills in Hive/Python with minimum 5 Years of Experience.Familiarity with big data processing tools and techniquesExperience with the Hadoop ecosystemGood understanding of distributed systemsShould be familiar with Data warehouse concepts.Experience with streaming data

Senior Data Engineer (Snowflake/Python) (NO H1B)

Syeta Inc

Woodbridge Township, New Jersey, USA

Full-time

REQUIREMENT: POSITION: Senior Data Engineer (Snowflake/Python) LOCATION : Iselin, NJ NOTE : VISA (NO H1B) JOB DESCRIPTION: Proven 13+ years of experience in Snowflake data warehousing DevelopmentExpert in Python & Pyspark for data processing and automation.Strong expertise in Strong SQL and SQL query optimization skillsStrong knowledge of data warehousing concepts and best practices.Familiarity with Snowflake's architecture, features, and best practices.Experience with data modeling, ETL develop

Integration Engineer

Excelque, Inc

New York, New York, USA

Contract

We are urgently hiring for Integration Engineer - United States. Title: Integration Engineer Location: Metropark, NJ Experience: 10+ Years Duration: Long Term If you are interested in this position, please share your updated resume to Job Description: Title: Integration Engineer - specifically with Astronomer Airflow experience This position is for an Integration engineer with a background in Airflow, Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for

Python Developer

Collabera LLC

Jersey City, New Jersey, USA

Full-time

Industry: Banking & Finance Work Location: Jersey City (Hybrid) Job Title: Python Developer Payrate: $70-75/hr Must Haves: 2+ years of professional experience in Python development with a focus on back-end technologies. Hands-on experience with PySpark and big data processing. Strong understanding and experience with Teradata SQL and database management. Familiarity with version control systems (e.g., Git) and development tools. Key Responsibilities: Develop, test, and maintain efficient ba

Integration Engineer

PeopleNTech

Woodbridge Township, New Jersey, USA

Contract, Third Party

Major Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.Design, develop, and deploy Spark program in data bricks environment to process and analyse large volumes of data.Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.Proficient in developing programs in Python and SQLExperience with Data warehouse Dimensional data modelling.Working with even

Azure Data Engineer

Swanktek

Jersey City, New Jersey, USA

Contract

Role: Azure Data Engineer Location: Iselin, NJ 3 Days Hybrid from Day 1 Must Have: SnowflakeSQLPythonADFAzure Data BricksPySparkData Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize data pipelines for efficient dat

Data Scientist

IDR Inc.

Jersey City, New Jersey, USA

Full-time

Data Scientist Ongoing contract (Client maintains right to hire after 3 months though rarely exercises this right)Location: Jersey City, New Jersey C2C Pay Rate: $90.00Job Summary We are seeking a seasoned Senior Data Scientist with 15+ years of experience in developing and deploying machine learning solutions. The ideal candidate should have hands-on expertise in MLOps (at least two end-to-end production deployments), solution architecture, and experience with one major cloud platform (AWS, Az

AWS Data Engineer (Entry Level) in NJ & TX

Brilliant Infotech Inc.

Edison, New Jersey, USA

Full-time

Role: AWS Data Engineer (Entry Level) Location: NJ, TX (5 days Onsite) Exp: 1-3 Years preferable Primary Skills: AWS, Python, PySpark, SQL Secondary Skills: Knowledge of DevOps/Data Science & ML Description: 1-3 years of experience programming in SQL, Python and relevant packages like Pandas, and with Apache SparkExperience writing clean code that utilizes object-oriented paradigms when appropriateA strong foundation in data modeling, architecture and data warehousingExperience working in a CI/

Member of Technical Staff - Machine Learning Engineer

Microsoft Corporation

New York, New York, USA

Full-time

Overview As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad - to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It's also inclusive: we aim to make AI accessible to all - consumers, businesses, developers - so that everyone can realize its benefits. Help us push the front

Palantir Foundry Data Engineer

PeakIT

Remote

Contract

12 Months+ Key things Python, Pyspark, Palantir Foundry Palantir Found experience a must. Remote Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platformIdentify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater sc

Java/Google Cloud Platform Engineer

Global Soft Systems

Remote or US

Contract

Java/Google Cloud Platform Engineer Remote Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients Java/Google Cloud Platform Engineer - Prime Therapeutics - Remote - Contract to Hire Project Scope: Have a tool call PQM App that tracks and measures performance, metrics, and goals for clients A ton of data coming from a variety of sources (100+) Legacy app built on access and .Net and was never set up for enterprise support o Will be maintaine

Data Scientist

City of New York

New York, New York, USA

Full-time

Company Description Job Description *IN ORDER TO BE CONSIDERED FOR THIS POSITION CANDIDATE MUST EITHER BE SERVING PERMANENTLY IN THE ECONOMIST TITLE, REACHABLE ON THE CIVIL SERVICE LIST, OR ELIGIBLE UNDER THE 55A PROGRAM.* Transportation Planning and Management (TPM) is responsible for the safe, efficient, and environmentally responsible movement of people and goods on the City's streets, supporting the larger goals of economic and social vitality for people living, working, and doing busines