apache spark Jobs in new york

Refine Results
381 - 400 of 440 Jobs

Senior Data and Observability Engineer (W2 only)

SATCON Inc

•

Jersey City, New Jersey, USA

Contract

Job Title: Senior Data and Observability Engineer Location: NJ (New Jersey) Duration: 12+ Contract Job Description: We are seeking a highly skilled Senior Data and Observability Engineer to design, implement, and manage advanced data analytics and monitoring solutions. This role combines expertise in Splunk, Dynatrace, Tableau, SQL, Machine Learning, and R Programming to drive operational excellence, application performance, and business insights. The candidate will build and maintain observabi
Easy Apply
Posted 16 days ago | Updated 9 days ago

Data Scientist (AI & LLM Specialist) - to 240k + bonus + equity (SK)

Phaxis, LLC

•

New York, New York, USA

Full-time

Salary: $180k to $240k + bonus + equity We are seeking a highly skilled Data Scientist with a focus on Large Language Models (LLMs) and Machine Learning (ML) to join our team. The ideal candidate will have deep experience in developing and deploying AI solutions, particularly using LLMs such as GPT-3, BERT, or similar technologies, to solve complex business problems. You will work closely with cross-functional teams to design, build, and deploy data-driven models that leverage advanced language
Easy Apply
Posted 32 days ago | Updated 16 days ago

Big Data Engineer

Cyber Space Technologies LLC

•

Berkeley Heights, New Jersey, USA

Contract, Third Party

Role: Data Engineer Location: Berkley heights, NJ (Hybrid) Experience with Big data technologies- Spark (java) for handling large scale data processeing proficiency in SQL and Database - querying, managing and manipulating data sets Knowledge of cloud platform- data storage, processing and deployment in a scalable environment (azure) CST provides its clients with complete, cost-effective, end-to-end personnel solutions across a range of industrial domains. CST's mission is to empower business
Easy Apply
Posted 60+ days ago | Updated 4 hours ago

Urgent Needed - Senior Data and Observability Engineer for NJ

SATCON Inc

•

Jersey City, New Jersey, USA

Contract, Third Party

Hi, Our client is looking for Senior Data and Observability Engineer for NJ (New Jersey) location. If you are looking for a job change, please let me know. Job Title: Senior Data and Observability Engineer Location: NJ (New Jersey) Duration: 12+ Contract Job Description: We are seeking a highly skilled Senior Data and Observability Engineer to design, implement, and manage advanced data analytics and monitoring solutions. This role combines expertise in Splunk, Dynatrace, Tableau, SQL, Machine
Easy Apply
Posted 18 days ago

Big Data Engineer - (Remote / Only for W2)

Primus Software Corp

•

US

Contract

Job Title: Big Data Platform Development Engineer Duration: 6 - 7+ months Contract Possibility of extension Locations: Remote - Texas *Only W2 Candidates* Discription: You will evolve the data cloud platform and building pipelines that are scalable, robust and resilient, to validate, ingest, normalize/enrich and support business rule processing of data. You will provide leadership in big data and cloud technologies. 5+ years of experience with Big Data pipelines with Spark in Java, Scala, Pyth
Easy Apply
Posted 60+ days ago | Updated 10 days ago

Core Java Developer

BCforward

•

Hoboken, New Jersey, USA

Contract

Core Java Developer BCforward is currently seeking a highly motivated Core Java Developer for an opportunity in Jersey City, NJ! Position Title: Core Java Developer Location: Jersey City, NJ Anticipated Start Date: Tentative Start Date Please note this is the target date and is subject to change. BCforward will send official notice ahead of a confirmed start date. Expected Duration: 3+ Months contract to hire Job Type: Contract, [On-Site] Pay Range: [$61.23] to [$65.18] Please note that
Posted 3 days ago | Updated moments ago

Teradata Developer

Innova Solutions, Inc

•

Jersey City, New Jersey, USA

Contract

Innova Solutions is immediately hiring for a Teradata Developer Position: Teradata Developer Position Type: W2-Contract Location: Jersey City, NJ, Plano, TX and Charlotte, NC Work Mode: Hybrid Job Description: Analyze, design, develop, enhance, and support applications that integrate with existing business components utilizing established processes, frameworks, and technologies. Develop and support existing and new project requirements, including coordinating with business to understand requir
Easy Apply
Posted 60+ days ago | Updated 5 days ago

Dot Net Developer

Idexcel Inc.

•

Montvale, New Jersey, USA

Contract

IDEXCEL Client is Looking for .Net Developer @ Montvale, NJ on Contract to hire basis Job Title: .Net Developer Location: Montvale, NJ Duration: 12+ Months Duties: Coding, testing and debugging programs according to computer engineering specificationsModifying, expanding and updating applicationsCommunicating with a team that includes analysts, engineers and quality assurance testers in order to coordinate and document application development and testingDeveloping software prototypesThis assig
Easy Apply
Posted 60+ days ago | Updated 4 days ago

Google Cloud Platform Data Migration Consultant

TekDallas

•

Remote

Contract

Position: Google Cloud Platform Data Migration Consultant Location: 100% Remote (EST time zone) Contract Duration: long Term Only W2 Qualifications: 8+ years of overall IT ExperiencePrior migration experience from Snowflake DB to Google Cloud PlatformMust have basic ETL tasks and Python, PySpark, SQL experience. Strong with PySpark (esp. Spark SQL) for complex transformation pipelinesHands-on with Airflow for orchestration and BigQuery SQL for querying and data modelingGood experience in Goog
Easy Apply
Posted 4 days ago | Updated 4 days ago

IBM Watson X application developer

Alliance Sourcing Network

•

Parsippany-Troy Hills, New Jersey, USA

Third Party, Contract

Onsite interview required Job Description: We are seeking an experienced and motivated Application Developer with expertise in the IBM WatsonX platform to join our dynamic team. As an Application Developer, you will be responsible for designing, developing, and deploying cutting-edge AI-powered applications and solutions utilizing the IBM WatsonX platform. Your ability to leverage WatsonX's powerful tools and AI capabilities will be crucial in delivering innovative solutions that address busine
Easy Apply
Posted 17 days ago | Updated 11 days ago

Databricks Platform Architect

People Force Consulting Inc

•

Remote

Contract

This role offers candidates the opportunity to work with cutting-edge cloud and data technologies, gain expertise in Databricks architecture, optimize performance and costs, and contribute to building a scalable global platform. It s a great chance to enhance skills in data engineering, security, and multi-region deployments while collaborating with industry professionals. Job Description Deep understanding of Databricks architecture, including clusters, notebooks, jobs, and the underlying compu
Easy Apply
Posted 3 days ago | Updated 15 hours ago

Python Developer

Innova Solutions, Inc

•

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for a Python Developer. Position type: Contract Duration: Long Term Location: Jersey City, NJ (Hybrid 3 days Onsite) As a Python Developer, you will: This role will be responsible for hands-on application development to support the current and target process, as well as partnering with the multiple Technology teams to implement the target architecture and migration to strategic platform. Required Skills: 5+ years of experience in Python development exper
Easy Apply
Posted 60+ days ago | Updated 10 days ago

Data Engineer

Charter Solutions Inc.

•

Remote

Full-time

Data Engineer Information Technology Job Description: Data Engineer Data Engineer Roles and Responsibilities: Collect and process raw data at scale for a variety of projects and initiatives Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects Read, extract, transform, stage and load data to selected tools and frameworks as required and requested Perform tasks such as writing scripts, web scraping, calling API
Posted 60+ days ago | Updated moments ago

Data Warehouse Architects / Engineers

TECH Tammina

•

New York, New York, USA

Contract, Third Party

Job Title: Data Warehouse Architects / Engineers Location: NYC, NY Experience: 14+ years in the IT industry. 8+ years working with US companies in the US. 8+ years as a Data Architect/Engineer. 5+ years of recent experience (since 2015) in a major banking or brokerage house environment. 6+ years with Informatica and Azure. 6+ years designing and implementing ETL processes using SQL, ETL tools, and Linux shell scripting. 4+ years with AWS. 7+ years of programming experience with Python. Experie
Easy Apply
Posted 60+ days ago | Updated 4 hours ago

Azure Data Engineer

Zealogics

•

Remote

Contract

Responsibilities: Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges. Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the
Easy Apply
Posted 1 day ago

Google Cloud Platform Engineer

SGS Consulting

•

Remote

Contract

Title: Google Cloud Platform Engineer Location: 100% Remote Job ID: Google Cloud Platform0513 Job Duration: 06 Months (High Chances of Extension) The incumbent is responsible for the definition, development, and implementation of new systems, and major enhancements to existing systems, as well as production support for systems with high complexity. The incumbent is capable of providing project leadership for major feasibility or business systems analysis studies. Required Qualifications: Bachel
Easy Apply
Posted 23 days ago

QA/QC Data Validation Consultant_Remote

Libsys, Inc.

•

Remote

Contract

Responsibilities Data Validation: Analyze and validate data for accuracy, completeness, and consistency.Quality Assurance: Develop and implement data quality standards and processes.Issue Resolution: Identify and resolve data quality issues, ensuring compliance with regulations.Collaboration: Work with IT and data management teams to design and implement data strategies.Reporting: Generate data reports and presentations for management. Skill Strong experience in data validation and data quality
Easy Apply
Posted 2 days ago

data engineer with ML

Impetus IT

•

Remote or Seattle, Washington, USA

Full-time

We are partnering with one of our staffing partners who is searching for a Data engineer with Machine learning experience to design, develop, and optimize scalable data pipelines and infrastructure for ML-driven applications. The ideal candidate will have experience in big data technologies, ETL processes, and model deployment to support advanced analytics and AI initiatives.Salary $50k-70k slight flexibility for a good candidate.Due to low rates only direct applicants no c2c candidates please.
Easy Apply
Posted 19 days ago | Updated 4 days ago

GenAI Architect

MASH Pro Tech

•

Remote

Contract, Third Party

Role : GenAI Architect Location: Remote Primary Skills: (AI Data Scientist)Deep Expertise in the following:Large Language Models (LLMs) and Multimodels Foundation Model Architectures (Transformers, Encoder/Decoder) API integration from providers like (e.g., OpenAI, Cohere). Model tuning pipeline development Prompt engineering Reinforcement learning from human feedback (RLHF). Frameworks : PyTorch, TensorFlow,LangChain, LlamaIndex Strong programming skills in Python, and experience with data en
Easy Apply
Posted 8 days ago

Data Engineer III

V-Soft Consulting Group, Inc

•

Remote

Contract

Data Engineer (100% Remote) Primary Location: 100% Remote V-Soft Consulting is currently hiring for a Data Engineer (100% Remote) for our premier client. Education and Experience Atleast 5+ years of experience in Data Engineering. Must have Data Bricks experience. SQL Experience is required. Nice to Have experience with Spark Technologies. Strong Knowledge with Python is needed. Experience with Data Sets is a BIG plus. Interested? Qualified candidates should send their resumes to vmajji@vso
Easy Apply
Posted 1 day ago