hadoop big data spark engineer Jobs

Refine Results
1,341 - 1,360 of 1,418 Jobs

Agentic AI Data Engineer@Richmond, VA F2F

iBrain Technologies Inc.

Richmond, Virginia, USA

Third Party, Contract

Agentic AI Data Engineer Richmond, VA Hybrid & F2F Interview 12 Months Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems Experience training LLMs with structured and unstructured data sets highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems,

Sr Data Engineer (DBT, FiveTran, SQL) @ Fulltime with CriticalRiver

Critical River, Inc.

San Francisco, California, USA

Full-time

Hi , I hope you are doing well..!! Title: Sr Data Engineer (DBT, FiveTran, SQL) Location: Bay Area California (Hybrid) Duration: Fulltime with CR Years of Experience: 10-15 Years Job Description: A talented Senior Data Engineer to join our consulting practice. As a Senior Data Engineer, you will play a pivotal role in delivering data engineering solutions to our clients across various industries. You will work closely with clients to understand their business requirements, design and implement d

AWS Databricks Data Engineer (Hybrid onsite - W2 contract)

Xoriant Corporation

Quincy, Massachusetts, USA

Contract

Job Title : AWS Databricks Data Engineer Location: Quincy, MA (3- 4 days a week Hybrid onsite) Duration : Long term contract Contract: W2 / C2C IC (Own Individual corp only) Job Description: Client Note: In a nutshell we are looking for candidates who have hands on experience with migration of legacy applications from On-prem to AWS Public Cloud using AWS services such as EC2, ALB/ELB, S3, FSX, Opensearch, Kibana, CloudWatch, grafana, AWS Secret Manager with CyberArk, KMS and OIDC/ SAML integra

Senior Data Analyst

Computer Enterprises, Inc.

Pittsburgh, Pennsylvania, USA

Contract

Senior Data Analyst W2 Contract Hybrid (3 days on site 2 days remote) Pittsburgh/Dallas/Cleveland Key Responsibilities: Conduct UAT (User Acceptance Testing), exploratory data analysis, and root cause investigations. Gather and translate complex business requirements into technical documentation and logic. Develop lightweight coding solutions in SQL, Python, and/or Spark to support business rules and data transformations. Partner with business and technology teams to prototype and implement data

Data Scientist

BEAT LLC

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati

Azure Data Architect with MS Fabric - w2 role

Xyant Services, Inc.

Remote or Jersey City, New Jersey, USA

Contract

Job Description: We are seeking a highly experienced Data Engineering Lead/Architect with a strong background in SQL, Azure Data Services, and data modeling. The ideal candidate will possess a deep understanding of data warehousing, ETL/ELT processes, and big data technologies, and be capable of driving both the technical execution and team coordination in a fast-paced, dynamic environment.Key Responsibilities:Design, develop, and optimize complex SQL queries, dimensional data models, and schema

Databricks Engineer

SUNRAY INFORMATICS

Dallas, Texas, USA

Contract, Third Party

Hi Professionals, We have an immediate openins for the below role, If interested please apply. Job Title: Azure Databricks Engineer Type : ContractInterview: Telephonic & F2FJOB RESPONSIBILITIESNeed minimum 15+ years profiles of overall Experience.Candidates with in 15 miles of radius NeededROLE: SR.AZURE DATABRICKS ENGINEER- FINANCIAL EXPERIENCE MUSTMUST HAVE EXPERTISE IN THE SKILLS GIVEN BELOWAzure FunctionsSQL ServerPostgreSQLDatabricksStrong background in Data QualityOVERALL EXPERIENCE 15YRS

Software Engineers

Randstad Digital Manual LLC

Woburn, Massachusetts, USA

Full-time

Software Engineers for Randstad Digital, LLC. Multiple openings. Headquarters: Woburn, MA. Develop, design, implement, test, integrate web applications, API, jobs, scalable data solutions, cloud functions, pipelines. Write scripts, troubleshoot performance, confer with Data and Analytics team to build Data Lake, use data pipelines from data sources, migration framework. Review customer transaction records and deliver to downstream users, support data workflows, validate data integrity after inge

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami

Senior Software Developers

Randstad Digital Manual LLC

Woburn, Massachusetts, USA

Full-time

Senior Software Developers for Randstad Digital, LLC. Multiple openings. Headquarters: Woburn, MA. Develop, design, code, test, document, and support programs, data warehouse, scripts, applications. Confer with business, QA, Production Support to meet requirements and implementation. Review business functions, implement OID for automated selection of active servers, develop queries and algorithms from upstream users, optimize enterprise data flows, and review acquisition, storage and processing

Palantir Data Integration Engineers

ITECS

US

Third Party

Palantir Data Integration Engineers Start date : 4/15/2025 End date: 10/31/2025 Bil Rate cap: : $65 Location: Jersey City, Remote Need for 10+ years' experience candidates Skills: 1. Palantir Platform Knowledge: Deep understanding of Palantir's software suite, including Palantir Gotham and Palantir Foundry, particularly the Kappa (streaming data) and Lambda (batch data) architectures. 2. ETL/ELT Processes: Experience with Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) pr

Python Developer

Innova Solutions, Inc

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for a Python Developer. Position type: Contract Duration: Long Term Location: Jersey City, NJ (Hybrid 3 days Onsite) As a Python Developer, you will: This role will be responsible for hands-on application development to support the current and target process, as well as partnering with the multiple Technology teams to implement the target architecture and migration to strategic platform. Required Skills: 5+ years of experience in Python development exper

Senior AI/ML Data Scientist

Global CI

Woodlawn, Maryland, USA

Full-time

Selected candidate must be willing to work on-site in Woodlawn, MD 5 days a week. Key Required Skills: Strong knowledge of AI/ML/LLM, Python, NLP, Generative AI and experience in the clinical domain. Basic Qualifications Bachelor's degree in Statistics, Applied Mathematics, Computer Science, or Information Science with industry experience on NLP, data science, AI/ML/LLM engineering.Minimum 8 Year (s) of Data Scientist experienceMust be able to obtain and maintain a Public Trust. Contract require

Training Manager-Data Scientist

Digitech Services

Texas City, Texas, USA

Contract, Third Party

This is Trainer/tutor role. A highly accomplished Data Scientist Trainer with over 10 years of applied expertise, this professional stands at the intersection of machine learning, big data analytics, statistical modeling, and AI strategy. With a robust track record of mentoring aspiring data scientists and upskilling professionals, the trainer specializes in transforming learners into high-impact contributors who can bridge the gap between data and business value. Participants are equipped with

Lead Ab Initio Developer

Trigint Solutions

Remote

Contract

Description: The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on leading the development of solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company. Essential functions: 20% Lead the

Data Engineer - FTE role

Winston Staffing Service

Buffalo, New York, USA

Full-time

Location Buffalo/Niagra Falls Area - Hybrid Work week Full Time Employee plus benefits. Support the day-to-day operations of Invisible deployments. Our customers rely on our platform for some of their most critical operations. Build, optimize, and maintain ETL pipelines Modify existing application code or interfaces, or develop new components Analyze requirements, participate in design, and handle coding, testing, debugging, deployment, and maintenance Develop and implement databases, data coll

Senior AI/ML Data Scientist

Omm IT Solutions

Milford Mill, Maryland, USA

Contract

Please Note: This is 100% On-Site Position. Selected candidate must be willing to work on-site in Woodlawn, MD 5 days a week. Position Description: Stay updated on the new methods in NLP, ML and Generative AI Understand real world challenges and develop automated data solutions Develop, test, and deploy new techniques for NLP understanding Scalable development/deployment of ML and Generative AI approaches (such as Large Language Models (LLMs) Train and optimize NLP/LLM models and create Python

Platform Engineer - Databricks

Sunrise Systems, Inc.

Remote

Contract

Our client, a leading apparel and sporting goods manufacturing company, is looking for a Platform Engineer - Databricks. This is for an initial duration of 12 months and is a REMOTE position. Job Type: Contract (Candidates must be able to work on W2 without VISA sponsorship) Must Haves: Dataricks,PlatformAIML experience Required: Strong Computer Science fundamentals2+ years professional software development experienceProgramming - Python AND GolangInfrastructure as Code / Dev Ops practices and

Senior AI/ML Data Scientist

Sky Solutions LLC

Woodlawn, Maryland, USA

Contract

Job Title: Senior AI/ML Data Scientist Duration: Long term Location: Woodlawn, MD (Onsite 5 days a week) Note: Selected candidate must be willing to work on-site in Woodlawn, MD 5 days a week. Key Required Skills: Strong knowledge of AI/ML/LLM, Python, NLP, Generative AI and experience in the clinical domain. Position Description: Stay updated on the new methods in NLP, ML and Generative AIUnderstand real world challenges and develop automated data solutionsDevelop, test, and deploy new techn

RTA Posted Job Description

Russell, Tobin & Associates

Remote or New York, New York, USA

Contract

Our client, a Tech industry is looking to hire a Data Scientist V in Remote- EST preferredPay Rate Range: $100-$100/hr. on w2., depending on experienceRole - Data Scientist V Remote - Remote- EST preferred Duration - 6 months Pay range - $100-$100/hr. on w2.Summary: The main function of the Data Scientist is to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets.Key Projects/Day-to-Day Responsibilities: * Role will be even more focused on