Big data jobs

New York, New York

•

6d ago

Required Qualifications: 8+ years experience with ETL/ELT process and frameworks is a must 8+ years expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL 5+ years proficient in Python and Scala programming for data engineering tasks, automations 8+ years strong in GIT repo and CI/CD deployment process 5+ years experience with Big Data Hadoop, Spark 5-8 years experience in the following domains: Asset Management Financial Services Investment Management Hedge

Easy Apply

Contract

Depends on Experience

Big Data Application Developer with Databricks || Columbia, SC (Day 1 onsite - Locals only) || Must have linkedin and 10+ years of exp.||

Columbia, South Carolina

•

2d ago

Big Data Application Developer with Databricks Columbia, SC (Day 1 onsite - Locals only) Must have linkedin and 10+ years of exp. Experience: Minimum 10+ years in application development, systems testing, or similar roles Technical Proficiency: Advanced understanding of development, QA, and integration methodologies Strong command of programming languages, systems analysis, and software design Experience working across mainframe, midrange, or PC/LAN environments Familiarity with project managem

Easy Apply

Contract

Up to $60

Principal Engineer Software (Big Data)

Santa Clara, California

•

Today

Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We take our mission of

Full-time

USD 147,000.00 - 237,500.00 per year

Sr Principal Engineer Software (Big Data)

Santa Clara, California

•

Today

Full-time

USD 170,000.00 - 277,000.00 per year

Big Data Engineer

Washington, District of Columbia

•

Today

Job ID: 2509498 Location: WASHINGTON, DC, US Date Posted: 2025-10-02 Category: Information Technology Subcategory: Big Data Engineer Schedule: Full-time Shift: Day Job Travel: No Minimum Clearance Required: TS/SCI with Poly Clearance Level Must Be Able to Obtain: None Potential for Remote Work: No Description SAIC is seeking Big Data Engineers to join the Machine-assisted Analytic Rapid-repository System (MARS) Advanced Development Operations (DevOps) and Sustainment Support (ADOS) pr

Full-time

USD 160,001.00 - 200,000.00 per year

Big Data Engineer

Mississauga, Ontario

•

Today

Grow your career as a Big Data Engineer with an innovative global bank in Mississauga, Ontario. Contract role with strong possibility of extension or conversion. Will require working a hybrid schedule 3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.

Easy Apply

Full-time

66/hr - 71/hr

Lead Big Data/Data Processing/Pyspark

Chicago, Illinois

•

2d ago

Employment : W2 Minimum years of experience: 8+ Years of experience Job Description:Data Pipeline Development: Design, develop, test, and deploy robust and scalable data pipelines using PySpark for data ingestion, transformation, and loading (ETL/ELT) from various sources (e.g., S3, ADLS, databases, APIs, streaming data).Big Data Processing: Utilize PySpark to process large datasets efficiently, handling complex data transformations, aggregations, and data quality checks.Performance Optimizatio

Easy Apply

Contract

$45 - $50

Senior Big Data Engineer

Irvine, California

•

Today

job summary: Senior Big Data Engineer - Data Infrastructure This Senior Big Data Engineer role is critical to the organization's mission of delivering dependable, high-performance smart home and networking products globally. The position is situated within a dedicated engineering team responsible for architecting and optimizing the foundational data infrastructure. You'll drive the development of terabyte-scale data pipelines on AWS, ensuring high performance, fault tolerance, and security for

Full-time

USD180,000 - USD200,000

Big data developer - W2 (NO C2C,1099) - Charlotte, NC (3 days a week) - Posted by tauqeer

Hybrid in Charlotte, North Carolina

•

4d ago

Must have: Hadoop, Pyspark and Kafka knowledge Key Responsibilities: Design and implement scalable data ingestion and transformation pipelines using PySpark or Scala, Hadoop, Hive, and Dremio.Build and manage Kafka batch pipelines for reliable data streaming and integration.Work with on-prem Hadoop ecosystems (Cloudera, Hortonworks, MapR) or cloud-native big data platforms.Develop and maintain RESTful APIs using Python (FastAPI, Flask, or Django) to expose data and services.Collaborate with data

Easy Apply

Contract

$55

Data Engineer

Phoenix, Arizona

•

Yesterday

Job Title: Data Engineer Experience: 1-4 years Employment Type: Full-Time No Sponsorship Are you excited about taking your technical career to new heights with a full-time, W-2 role as a consultant in a dynamic and rapidly growing company? If you are, let's get in touch your interest is the first step to starting the conversation. What This Role Requires: 1-4 years of programming experience after your degreeMust have coding experience in both Python and SQLIt is preferred that you have experienc

Easy Apply

Full-time

$30 - $35

Senior Big Data Engineer

Remote or Atlanta, Georgia

•

Today

RESPONSIBILITIES: Kforce has a client that is seeking a remote Senior Big Data Engineer to join their team. Summary: The team supports a portal and product landing page, which supports all marketing functions of the website. Currently, they are operating under one monolithic application and want to decouple into loosely coupled microservices. The individual they are looking for will be focused on the data side of the project and make sure the data is clean, structured, and stored in the right p

Contract

$40 - $50 hourly

Big Data Developer

Hybrid in Charlotte, North Carolina

•

4d ago

Position: Big Data Developer Location: Charlotte, NC (Hybrid Model) Job Type: 6-24 Months Contract to hire FTE Note: Only W2 (No C2C) Required Skills & Qualifications Experience in Big Data Engineering.Strong hands-on experience with PySpark or Scala.Deep expertise in on-prem Hadoop distributions (Cloudera, Hortonworks, MapR) or cloud-based big data platforms.Proficiency in Kafka batch processing, Hive, and Dremio.Solid understanding of REST API development using Python frameworks.Familiarity wi

Easy Apply

Contract

Depends on Experience

Bigdata Engineer

Irvine, California

•

17d ago

Position: BigData Engineer - Hadoop Admin Location: Irvine, CA Duration: 12 months(W2 only) Requirements: 10+ years of experience in Platform Engineering, Site Reliability Engineering, or similar roles, with proven success managing large-scale, distributed Hadoop infrastructure.Deep expertise in the Hadoop ecosystem, including HDFS, YARN, Hive, Spark, NiFi, Ambari, and Iceberg.Strong Linux system administration skills (CentOS/Rocky preferred), including system tuning, performance optimization, a

Easy Apply

Contract

$50 - $60

Principal Software Engineer - Big Data Processing

No location provided

•

Today

Job Description products impact and disrupt the healthcare industry by transforming how healthcare and technology intersect. You will have the opportunity to: Reach billions of people with our products and services Create technology which truly impacts the world Have immediate impact on developing this technology Unlimited growth potential with inspiring work Work with the best minds in the industry Work in an open, diverse, and productive environment About the Job Oracle Health Data Intelli

Full-time

USD 96,800.00 - 223,400.00 per year

Big Data - NoSQL@ Irving, TX 75039 _ Onsite

Irving, Texas

•

2d ago

Job Title: Big Data - NoSQL Location: Irving, TX 75039 _ Onsite Duration: Long Term on W2 Please share the resume by Job Details< data-start="378" data-end="403">Must Have SkillsGoogle Cloud Platform BigQuery Cloud Storage Dataflow, Dataproc, and Composer (Airflow) Detailed Job Description4 6 years of experience in data architecting, with at least 2 years in Google Cloud Platform. 4 6 years of experience in data engineering, with at least 2 years in Google Cloud Platform. Strong hands-on exper

Easy Apply

Contract

$55 - $60

Principal Technology Architect Big Data (Cosmos)_W2Only

Cincinnati, Ohio

•

9d ago

Job Opening: Principal Technology Architect Big Data (Cosmos) Location: Cincinnati, OH 45202 (Onsite) Duration: 6 Months | Start Date: October 10, 2025 About the RoleWe are looking for a highly experienced Principal Technology Architect with over 10 years of expertise in Big Data (Cosmos) and modern cloud-based Java architectures. The ideal candidate will have strong full-stack development and cloud integration skills, combined with leadership experience in Agile and DevOps environments. Key Res

Easy Apply

Full-time

Depends on Experience

Contract Opportunity - Big Data Architect at Phoenix, AZ

Phoenix, Arizona

•

Today

Hi , This is Van from SYSMIND. Below is the job description for your reference Title: Big Data Architect Location: Phoenix, AZ Duration: 6+ months with possible extension Job Description: Digital : BigData and Hadoop Ecosystems Advanced Java Concepts Thanks and Regards, Van Sr. US IT Recruiter Office: Extension: 2219 Mobile: Email: IMPORTANT: The contents of this email and any attachments are confidential. They are intended for the named recipient(s) only. If you have received this email by mi

Easy Apply

Contract

Big Data Engineer

Santa Monica, California

•

Today

Description: **Onsite | Santa Monica, CA** Are you passionate about building scalable data platforms that deliver real-world impact? Our Ad Platforms Engineering team is at the forefront of advertising technology, creating cutting-edge solutions that enhance performance and value across all media channels. We're seeking a seasoned engineer to design and maintain robust data infrastructure, lead architectural decisions, and collaborate across disciplines to shape the future of ad tech. Due to c

Contract

Solution Architect / Big Data Mesh Architect / Data Mesh Leader

Remote

•

3d ago

Sr Solution Architect / Databricks, Immuta, Starburst, Collibra, and AWS Duration: - 12 Months Location: - San Francisco, CA /Any other bank location in the USA / Hybrid Qualifications: Position Summary As a Senior Solution Architect, you will design comprehensive data and analytics solutions leveraging cutting-edge technologies including Databricks, Immuta, Starburst, Collibra, and AWS. You will create reusable data management patterns and provide technical leadership to the data engineering t

Easy Apply

Contract

Depends on Experience

Technology Architect | Big Data - NoSQL | Marklogic

Irving, Texas

•

Today

Job Title : Technology Architect | Big Data - NoSQL | Marklogic Work Location : Irving, TX 75039 Contract duration : 6 + months Only independent resources Job Details: Must Have Skills Google Cloud Platform Big Query Cloud Storage Dataflow, Dataproc, and Composer (Airflow) Detailed Job Description 4 to 6 years of experience in Data architecting, with at least 2 years in Google Cloud Platform.4 to 6 years of experience in Data Engineering, with at least 2 years in Google Cloud Platform. Strong

Easy Apply

Contract

BASED ON EXPERIENCE

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization