Big data jobs

New York, New York

•

1d ago

Required Qualifications: 8+ years experience with ETL/ELT process and frameworks is a must 8+ years expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL 5+ years proficient in Python and Scala programming for data engineering tasks, automations 8+ years strong in GIT repo and CI/CD deployment process 5+ years experience with Big Data Hadoop, Spark 5-8 years experience in the following domains: Asset Management Financial Services Investment Management Hedge

Easy Apply

Contract

Depends on Experience

Sr. Software Engineering Manager - Big Data

Washington

•

Today

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate

Full-time

USD 184,000.00 - 253,000.00 per year

Principal Engineer Software (Big Data)

Santa Clara, California

•

Today

Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We take our mission of

Full-time

USD 147,000.00 - 237,500.00 per year

Sr Principal Engineer Software (Big Data)

Santa Clara, California

•

Today

Full-time

USD 170,000.00 - 277,000.00 per year

Big Data Engineer, onsite

Tampa, Florida

•

3d ago

Role: Big Data Engineer, onsite in Jersey City, NJ / Tampa, FL - Full-time Job description: 375058/-CO Experience Required: 5 - 15 + Years Must Have Technical/Functional Skills Strong experience in Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, and Autosys. Data Analysis and Data Wrangling skills when dealing with a Huge Volume. Performance analysis, troubleshooting, and resolution, including the Cloudera Big Data ecosystem. Experience with Linux-based infrastructures. Competencies: Str

Easy Apply

Full-time

$100,000 - $120,000

Senior Big Data Engineer

Hybrid in Costa Mesa, California

•

5d ago

Position: Senior Big Data Engineer Location: Costa Mesa, CA Duration: 12+ Months Our team is responsible of dealing with huge amount of data and also have an integration from various systems, create a required pipeline, and schedule, also team is dealing with steaming data for Realtime applications. What you will do here: Design & build all batch/Realtime components/data pipelines lines/integrations for our MLOps platform on AWS.Collaborate with geographically distributed cross-functional teams

Easy Apply

Contract

Depends on Experience

Big Data Engineer

Washington, District of Columbia

•

Today

Job ID: 2509498 Location: WASHINGTON, DC, US Date Posted: 2025-10-02 Category: Information Technology Subcategory: Big Data Engineer Schedule: Full-time Shift: Day Job Travel: No Minimum Clearance Required: TS/SCI with Poly Clearance Level Must Be Able to Obtain: None Potential for Remote Work: No Description SAIC is seeking Big Data Engineers to join the Machine-assisted Analytic Rapid-repository System (MARS) Advanced Development Operations (DevOps) and Sustainment Support (ADOS) pr

Full-time

USD 160,001.00 - 200,000.00 per year

Big data developer in Charlotte, NC(Hybrid)- W2 opportunity

Hybrid in Charlotte, North Carolina

•

9d ago

Position title: Big data developer Location: Charlotte, NC Onsite: 3 days a week Contract: 6-24 months to perm F2F interview needed Must have: Hadoop, Pyspark and Kafka knowledge Key Responsibilities: Design and implement scalable data ingestion and transformation pipelines using PySpark or Scala, Hadoop, Hive, and Dremio.Build and manage Kafka batch pipelines for reliable data streaming and integration.Work with on-prem Hadoop ecosystems (Cloudera, Hortonworks, MapR) or cloud-native big data pl

Easy Apply

Contract

Depends on Experience

Big Data Engineer

Mountain View, California

•

Yesterday

A globally leading consumer device company based in Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable cloud services that power the world s best-selling mobile devices. As part of the Knox Cloud Team, you ll play a key role in transforming research projects into production-ready cloud platforms and service infrastructures. We re looking for world-class server software engineers with strong expertise in Big Data infrastructure and data warehousing to join our in

Easy Apply

Contract

$80 - $95

Big Data Lead with Azure || Philadelphia, PA || Fulltime or W2 // Hybrid

Philadelphia, Pennsylvania

•

Yesterday

Role: Azure Big data lead (With Healthcare PAYER ) Location: Philadelphia, PA Mode of work: Hybrid (3 days/week) Anticipated start date: - Immediate Fulltime // W2 Only Job Description: Overall 14+ years of Azure & Data Engineering experience Design and develop cloud-native applications and services using modern architecture patterns. Collaborate with product managers, developers, and other stakeholders to define application requirements and specifications. Strong hands-on experience in Databas

Easy Apply

Full-time

Senior Big Data Engineer

Irvine, California

•

Today

job summary: Senior Big Data Engineer - Data Infrastructure This Senior Big Data Engineer role is critical to the organization's mission of delivering dependable, high-performance smart home and networking products globally. The position is situated within a dedicated engineering team responsible for architecting and optimizing the foundational data infrastructure. You'll drive the development of terabyte-scale data pipelines on AWS, ensuring high performance, fault tolerance, and security for

Full-time

USD180,000 - USD200,000

Big Data Engineer (Only on W2)

Atlanta, Georgia

•

2d ago

Role: Big Data Engineer Location: Atlanta, Georgia Experience Level: 10+ years Note: Only on W2 Required Skills Must be strong in UNIX Shell, Python scripting knowledge Must be strong in Spark Must have strong knowledge of SQL Hands-on knowledge on how HDFS/Hive/Impala/Spark works Strong in logical reasoning capabilities Should have working knowledge of GitHub, DevOps, CICD/Enterprise code management tools Strong collaboration and communication skills Must possess strong team player skills and s

Easy Apply

Contract

Depends on Experience

Senior Software Engineer - Big Data

Austin, Texas

•

Today

Job Description Oracle's Cloud Infrastructure team is building new Infrastructure-as-a-Service technologies that operate at high scale in a broadly distributed multi-tenant cloud environment. Our customers run their businesses on our cloud, and our mission is to provide them with best-in-class compute, storage, networking, database, security, and an ever-expanding set of foundational cloud-based services. We're looking for hands-on engineers with expertise and passion in solving difficult prob

Full-time

USD 79,800.00 - 178,100.00 per year

Big Data Developer

Hybrid in Charlotte, North Carolina

•

Yesterday

Position: Big Data Developer Location: Charlotte, NC (Hybrid Model) Job Type: 6-24 Months Contract to hire FTE Note: Only W2 (No C2C) Required Skills & Qualifications Experience in Big Data Engineering.Strong hands-on experience with PySpark or Scala.Deep expertise in on-prem Hadoop distributions (Cloudera, Hortonworks, MapR) or cloud-based big data platforms.Proficiency in Kafka batch processing, Hive, and Dremio.Solid understanding of REST API development using Python frameworks.Familiarity wi

Easy Apply

Contract

Depends on Experience

Senior Big Data Engineer

Hybrid in Pittsburgh, Pennsylvania

•

3d ago

Job at a Glance This is a long-term contract, with an initial term through June 2026, possibility of extension but the preference is to convert to FTE Pay range is $55-60/hr on W2; Eligible to sign up for benefits(Medical, Dental, Vision, and 401k) on day 1 Hybrid position in downtown Pittsburgh but may consider candidates who work in Cleveland, OH Projects involve designing and implementing new applications, maintaining existing applications, and supporting RTB (Run-the-Bank) functions Seeking

Easy Apply

Contract

Depends on Experience

Principal Software Engineer - Big Data Processing

No location provided

•

Today

Job Description products impact and disrupt the healthcare industry by transforming how healthcare and technology intersect. You will have the opportunity to: Reach billions of people with our products and services Create technology which truly impacts the world Have immediate impact on developing this technology Unlimited growth potential with inspiring work Work with the best minds in the industry Work in an open, diverse, and productive environment About the Job Oracle Health Data Intelli

Full-time

USD 96,800.00 - 223,400.00 per year

Bigdata Engineer

Irvine, California

•

30+d ago

Position: BigData Engineer - Hadoop Admin Location: Irvine, CA Duration: 12 months(W2 only) Requirements: 10+ years of experience in Platform Engineering, Site Reliability Engineering, or similar roles, with proven success managing large-scale, distributed Hadoop infrastructure.Deep expertise in the Hadoop ecosystem, including HDFS, YARN, Hive, Spark, NiFi, Ambari, and Iceberg.Strong Linux system administration skills (CentOS/Rocky preferred), including system tuning, performance optimization, a

Easy Apply

Contract

$50 - $60

Big Data Technical Architect

New York, New York

•

Today

Bachelor's or master's degree in computer science, Engineering, or a related quantitative field. 15+ years of progressive experience in software engineering, with at least 5+ years in a Technical Architect, Lead Data Architect, or Principal Data Engineer role, specifically focused on data quality, data governance, or data platform architecture. Exceptional hands-on proficiency and deep architectural understanding of the Big Data ecosystem: Apache Spark (PySpark, Scala, or Java): Expert-level ex

Easy Apply

Full-time

Big Data Engineer

Santa Monica, California

•

Today

Description: **Onsite | Santa Monica, CA** Are you passionate about building scalable data platforms that deliver real-world impact? Our Ad Platforms Engineering team is at the forefront of advertising technology, creating cutting-edge solutions that enhance performance and value across all media channels. We're seeking a seasoned engineer to design and maintain robust data infrastructure, lead architectural decisions, and collaborate across disciplines to shape the future of ad tech. Due to c

Contract

Technology Architect | Big Data - NoSQL | Marklogic

Irving, Texas

•

Today

Job Title : Technology Architect | Big Data - NoSQL | Marklogic Work Location : Irving, TX 75039 Contract duration : 6 + months Only independent resources Job Details: Must Have Skills Google Cloud Platform Big Query Cloud Storage Dataflow, Dataproc, and Composer (Airflow) Detailed Job Description 4 to 6 years of experience in Data architecting, with at least 2 years in Google Cloud Platform.4 to 6 years of experience in Data Engineering, with at least 2 years in Google Cloud Platform. Strong

Easy Apply

Contract

BASED ON EXPERIENCE

Filter Results

Job post features

Posted date

Work settings

Employment type

Distance

Employer type

Work authorization