Hadoop Big Data Spark Engineer Jobs

Refine Results
1,241 - 1,260 of 1,308 Jobs

Lead PySpark Developer

Accuro Group

Maryland, USA

Part-time, Third Party, Contract

Hi, Hope you are doing well, I am reaching out to you on an exciting job opportunity with one of our clients. Role name: Lead PySpark Developer Location: Owings Mills, MD Contract Role Description: Lead the design, development, and deployment of PySpark-based big data solutions. Architect and optimize ETL pipelines for structured and unstructured data. Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions. Opt

Data Architect: III (Senior)

Randstad Digital

Remote or Madison, New Jersey, USA

Contract

job summary: The Senior Data Engineer is responsible for designing and developing scalable, high-performance data solutions to support millions of users and clients. The role requires expertise in big data technologies such as Spark with Scala, Kafka, NoSQL databases, and AWS cloud services, with a focus on building robust data pipelines and platforms in a fast-paced, collaborative environment. Candidates should have extensive experience in real-time stream processing, data architecture, and a

Senior Java Developer 12+ years on W2

Divit Technologies, Inc.

Hanover, New Jersey, USA

Full-time

12+ Years of exp. Work experience as a Fullstack Developer with Core Java, Spring framework (Spring Boot & Spring Batch), RESTful API Services and Angular Experience in writing test cases and Unix Shell scripts Good Knowledge in Relational databases and SQL Problem-solving abilities Eager to learn new technologies in Big Data Space (Hive, Impala, Spark Sql, Scala etc). Any cloud experience (AWS/Azure/Google/Oracle). Desirable skills/Preferred Qualifications: Understanding of Big Data Technologie

Data Engineer

Dahl Consulting

Remote or Brooklyn Park, Minnesota, USA

Contract

Seeking a new job opportunity? Don t miss this role! Dahl Consulting is currently partnering with a leader in the retail industry. We work one-on-one with great candidates to help connect them with local employment opportunities. This Company is hiring a Data Engineer for a contract position! Interested? Get more details below.Contract Duration: 6-monthsWorksite Location: Brooklyn Park, MN | Hybrid or remoteCompensation: $60.00 - $90.00 per hourWhat you ll do as the Data Engineer: Design, build,

Sr Data Engineer (DBT, FiveTran, SQL) @ Fulltime with CriticalRiver

Critical River, Inc.

San Francisco, California, USA

Full-time

Hi , I hope you are doing well..!! Title: Sr Data Engineer (DBT, FiveTran, SQL) Location: Bay Area California (Hybrid) Duration: Fulltime with CR Years of Experience: 10-15 Years Job Description: A talented Senior Data Engineer to join our consulting practice. As a Senior Data Engineer, you will play a pivotal role in delivering data engineering solutions to our clients across various industries. You will work closely with clients to understand their business requirements, design and implement d

Azure Data Engineer

Kaynes Technology Inc

Woodbridge Township, New Jersey, USA

Contract

Role: Azure Data Engineer Location: Iselin NJ 3 Days Hybrid from Day 1 Note: Only W2 and EST Time Zone Must Have: SnowflakeSQLPythonADFAzure Data BricksPySparkData Warehouse Concepts Job Description : This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise. Major Responsibilities: Build and optimize

Data Scientist

BEAT LLC

Remote

Full-time

Job Description:Security Clearance: Secret Required BEAT is seeking two highly skilled Data Scientists to join our team, preferably with Army and NATO sustainment process knowledge. These positions will require expertise in Army Vantage and MAVEN, as well as advanced skills in various data science tools and methodologies. The ideal candidates will work remotely, the role requires daily engagement with process owners in the G4 and other MSC G4s. Flexible hours is crucial for effective communicati

Senior Data Analyst

Computer Enterprises, Inc.

Pittsburgh, Pennsylvania, USA

Contract

Senior Data Analyst W2 Contract Hybrid (3 days on site 2 days remote) Pittsburgh/Dallas/Cleveland Key Responsibilities: Conduct UAT (User Acceptance Testing), exploratory data analysis, and root cause investigations. Gather and translate complex business requirements into technical documentation and logic. Develop lightweight coding solutions in SQL, Python, and/or Spark to support business rules and data transformations. Partner with business and technology teams to prototype and implement data

AWS Databricks Data Engineer (Hybrid onsite - W2 contract)

Xoriant Corporation

Quincy, Massachusetts, USA

Contract

Job Title : AWS Databricks Data Engineer Location: Quincy, MA (3- 4 days a week Hybrid onsite) Duration : Long term contract Contract: W2 / C2C IC (Own Individual corp only) Job Description: Client Note: In a nutshell we are looking for candidates who have hands on experience with migration of legacy applications from On-prem to AWS Public Cloud using AWS services such as EC2, ALB/ELB, S3, FSX, Opensearch, Kibana, CloudWatch, grafana, AWS Secret Manager with CyberArk, KMS and OIDC/ SAML integra

Senior Ab Initio Developer

HPTech Inc.

Plano, Texas, USA

Contract

Technical Skillset Mandatory: Thorough understanding in ETL Architecture and being able to provide designs and solutions independently in ETLExperience working with various Ab Initio program components such as Reformat, Rollup,Scan, Join, Partition by key, - Partition by Round Robin, Gather, Merge, Sort, Lookup etc.Experience with various Ab Initio parallelism techniques, Ab Initio Graphs using Data, Pipeline Component parallelisms.Working knowledge in Bigdata / Hadoop Eco system and HDFS comman

Databricks Engineer

SUNRAY INFORMATICS

Dallas, Texas, USA

Contract, Third Party

Hi Professionals, We have an immediate openins for the below role, If interested please apply. Job Title: Azure Databricks Engineer Type : ContractInterview: Telephonic & F2FJOB RESPONSIBILITIESNeed minimum 15+ years profiles of overall Experience.Candidates with in 15 miles of radius NeededROLE: SR.AZURE DATABRICKS ENGINEER- FINANCIAL EXPERIENCE MUSTMUST HAVE EXPERTISE IN THE SKILLS GIVEN BELOWAzure FunctionsSQL ServerPostgreSQLDatabricksStrong background in Data QualityOVERALL EXPERIENCE 15YRS

Solution Architect with strong Kafka exp

Techno-Comp, Inc.

Remote

Contract

Job Title: Solution Architect with strong Kafka exp Location: Remote Duration: Long Term Contract Required Skills: Manage Platform with Senior Kafka, Airflow, DatabricksExperience with Big Data technologies (Spark, Redshift/ BigQuery/ Synapse/ Databricks, Kubernetes, PowerBI)Familiar with programming languages Python/Kotlin/Go/C/JavaAPI Building from scratchAPI Gateway buildingNetwork Components Required OSS, BSS, Telecom IQ, Network IQ, Detection Analysis, Predictive Analysis, Real Time Streami

Data Architect: III (Senior)

Dexian DISYS

No location provided

Contract

Job Title: Sr. Data Engineer Assignment Duration: Long Term Assignment Type: Contract Location: 100% Remote At Anywhere, we work to build and improve a platform that helps real estate professionals work effectively and helps delight home buyers and sellers with an excellent experience. We do that by combining great technology with great people - and were looking for a Senior Data Engineer to join our team. What were looking for: Youre a talented, creative, and motivated engineer who loves de

Palantir Data Integration Engineers

ITECS

US

Third Party

Palantir Data Integration Engineers Start date : 4/15/2025 End date: 10/31/2025 Bil Rate cap: : $65 Location: Jersey City, Remote Need for 10+ years' experience candidates Skills: 1. Palantir Platform Knowledge: Deep understanding of Palantir's software suite, including Palantir Gotham and Palantir Foundry, particularly the Kappa (streaming data) and Lambda (batch data) architectures. 2. ETL/ELT Processes: Experience with Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) pr

Lead Data Scientist (PhD) - Intelligent Forecast Application

Sierra Software Solutions

Plano, Texas, USA

Contract

Lead Data Scientist (PhD) - Intelligent Forecast Application Location: Plano, TX - 6-12 Months Contract Job Description :: We are seeking an exceptional and highly motivated Lead Data Scientist with a PhD in Data Science, Computer Science, Applied Mathematics, Statistics, or a closely related quantitative field, to spearhead the design, development, and deployment of an automotive OEM s next-generation Intelligent Forecast Application. This pivotal role will leverage cutting-edge machine learni

Python Developer

Innova Solutions, Inc

Jersey City, New Jersey, USA

Contract

A client of Innova Solutions is looking for a Python Developer. Position type: Contract Duration: Long Term Location: Jersey City, NJ (Hybrid 3 days Onsite) As a Python Developer, you will: This role will be responsible for hands-on application development to support the current and target process, as well as partnering with the multiple Technology teams to implement the target architecture and migration to strategic platform. Required Skills: 5+ years of experience in Python development exper

Lead Ab Initio Developer

Trigint Solutions

Remote

Contract

Description: The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on leading the development of solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company. Essential functions: 20% Lead the

RTA Posted Job Description

Russell, Tobin & Associates

Remote or New York, New York, USA

Contract

Our client, a Tech industry is looking to hire a Data Scientist V in Remote- EST preferredPay Rate Range: $100-$100/hr. on w2., depending on experienceRole - Data Scientist V Remote - Remote- EST preferred Duration - 6 months Pay range - $100-$100/hr. on w2.Summary: The main function of the Data Scientist is to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets.Key Projects/Day-to-Day Responsibilities: * Role will be even more focused on

Software Database Engineer 2

BCforward

Redmond, Washington, USA

Contract

Software Database Engineer 2 Bcforward is currently seeking a highly motivated Software Database Engineer 2 for an opportunity in Remote. Position Title: Software Database Engineer 2 Location: Remote Anticipated Start Date: ASAP Please note this is the target date and it is subject to change. Bcforward will send official notice ahead of a confirmed start date. Expected Duration: 18 Months Contract Job Type: Contract - Remote Pay Range: $50-$53 Please note that actual compensation may va

Senior Quality Engineering in Houston, TX

FSTONE Technologies

Houston, Texas, USA

Contract, Third Party

Top 3 Skills Needed: This particular role is to manage Sterling OMS, Fulfilment, and TMA PODs.Hands-on expertise with Sterling OMS requiredThis person has to work closely with clients and collaborate/work with offshore to ensure Sprint testing, E2E testing, and Downstream testing are on track as per the commitments.Supply Chain testing experience (Sterling Web SOM, Mobile SOM, RCP SOM, Fulfilment and Resa/Tlog)Retail domain experienceRequired Skills & Experience: 7+ years in Quality Engineering