Big data Jobs

Refine Results
1 - 20 of 1,800 Jobs

Tester - Big Data

91140551

Remote

Contract

Key Responsibilities: Partner with Data Engineers, Analysts, and business stakeholders to define quality requirements.Document test cases, data validation rules, and best practices for scalable data governance.Develop and implement test cases for ETL/ELT pipelines, data transformation, and ingestion processes.Perform data validation, execute test cases (manual or automated) and analyze results. Regression testing ensures sufficient error validation is present. Reconcile variances and data anomal

Sr Software Engineer (Big Data)

PaloAlto Networks

Santa Clara, California, USA

Full-time

Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We take our mission of

Big Data Programmer Analyst, AVP

Citi

Remote or Irving, Texas, USA

Full-time

Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products and services, including consumer banking and credit, corporate and investment banking, securities brokerage, transaction services, and wealth management. As a bank with a brain and a soul, Citi creates economic value that is systemically responsi

Software Engineer - Big Data Technologies

Apple, Inc.

No location provided

Full-time

Meaningful insights require a solid infrastructure that is able to scale with the large amount of data coming in. Our team is responsible for discovering such great insights from a sea of data, and our infrastructure needs innovative ideas to improve its performance and ease-of-use. Would you like to help understand the challenges of building and maintaining a large-scale analytics infrastructure? Are you excited about identifying areas for improvement and creating out-of-the-box solutions? If t

Junior data science engineer

Enhance IT

San Francisco, California, USA

Full-time

Job Title: Jr. Python Engineer(Urgent hiring) Location: San Francisco, CA, (Onsite) Employment type: Fulltime Duration: 2 years Exp: 1-2 years(Entry level) Educational Qualification: Bachelor s/Master s Degree in Computer Science, Information Systems, Electrical Engineering, Mathematics, or a related quantitative field. Are you excited about taking your technical career to new heights with a full-time, W-2 role as a consultant in a dynamic and rapidly growing company? If you are, let's get in t

Big Data Sr Manager - C13 - Hybrid

Citi

Remote or Tampa, Florida, USA

Full-time

The Big Data Sr manager is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. At least two years (Over all 10+ hands on Data Engineering experience) of experience building and leading highly complex, technical data engineering teams.Lead data engineering team, from sourcing to closing.

Sr Staff Engineer Software (Java Backend, Distributed Systems - Big Data Cloud Platform)

PaloAlto Networks

Santa Clara, California, USA

Full-time

Company Description Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We take our mission of

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer (Python/Spark/AWS) for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) We are seeking a Big Data Engineer to lead the design, develop, and maintain scalable data pipelines and infrastructure to support our market regulation technology applications. You will play a key role in modernizing existing data pipelines, enabling downstream use

Big Data Engineer

Software Guidance & Assistance

Rockville, Maryland, USA

Contract

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a Contract assignment with one of our premier Regulatory clients in Rockville, MD. This role is hybrid (2 days/week Onsite) Responsibilities : Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala). Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable. Stay cu

Capital Markets - Big Data Lead Developer (VP) - Hybrid

Citi

Remote or Tampa, Florida, USA

Full-time

The Data Fabric Team is building the next generation data fabric to solve for business, analytics and growing regulatory needs. Vast amounts of data assets have been accumulated through the years. Data fabric built on emerging technologies will facilitate the data being inspected, cleansed, transformed for support decision-making We are looking for a highly motivated, self-starter Senior Big Data Developer (Applications Development Tech Lead - C13) with a passion for data and with the ability t

Big Data Developer

Software Guidance & Assistance

Jersey City, New Jersey, USA

Full-time

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Developer for a direct placement assignment with one of our premier financial services clients in Jersey City, NJ. Required Skills: 8-12 years of relevant experience Extensive experience on Bigdata technologies - Spark, Scala/Java & Cloudera CDP Experience in writing SQL queries, data analysis & optimization Knowledge of scripting languages such as Unix shell Knowledge of various components of Cloudera CDP platform Stron

W2-Hybrid :: Big Data Engineer / Developer

Bitsoft International, Inc.

Charlotte, North Carolina, USA

Full-time

Big Data Engineer / Developer 6+Months Charlotte, NC (Hybrid) **Core Requirements** - At least 6 years' proficiency in Big Data, Spark, Scala, and Cloud technologies - Proven expertise in utilizing Spark and Scala, as well as familiarity with leading cloud services providers, notably AWS, Azure, and Google Cloud Platform for Big Data operations - Advanced knowledge and operational skills with Azure Data Lake Storage (DLS) - Demonstrable proficiency in using Databricks for data integration and pi

BIG DATA DEVELOPER

DVARN

Jersey City, New Jersey, USA

Contract

Job DescriptionJob title: Big data developer Location: jersey city, NJ Contract: 6-18 months Must have: Core java, Hadoop, scala, oracle, devops Nice to have: apache spark Project: get data from multiple teams. Then they build and consolidate it, data can be used by trading desk with the bank, trading desk from the data and put it into the system, one more level into data because as the system grows, its all getting changed, legacy platform, hard to do this within oracle and that s the reason th

Big Data Engineer - C13 - IRVING

Citi

Remote or Irving, Texas, USA

Full-time

The Big Data Engineer is a strategic professional who combines deep domain knowledge with modern data engineering and AI capabilities to drive high-impact solutions. The role demands strong commercial awareness, technical leadership, and the ability to influence key stakeholders. The ideal candidate will have a strong foundation in traditional ML techniques, Deep learning, and Generative AI, along with hands-on experience in big data platforms and data engineering stacks (Hadoop, PySpark, SnowFl

Fulltime opportunity - Bigdata Solution Architect - Onsite Role - Jersey City, NJ

Photon

Jersey City, New Jersey, USA

Full-time

FTE - Bigdata Solution Architect Photon Onsite role Jersey City, NJ Architect, implement, and optimize end-to-end solutions designed for large-scale datasets, ensuring scalability and efficiency. Big data ecosystem (Good understanding of Hadoop, Cloudera), exposure to Hive, Impala, Yarn, Kafka. Drive cross-functional collaboration, bridging technical teams and business stakeholders. Oversee data pipeline design, model development, and deployment with a focus on scalability and accuracy. Drive co

Big Data Spark Lead

VDart, Inc.

Berkeley Heights, New Jersey, USA

Contract, Third Party

Position: Big Data Spark Developer Location: Berkeley Heights, NJ Duration: Contract Job Description Microservice development in Scala Responsible for effective microservice development in Scala and delivery of our NextGen transformation/ professional services projects/programs Candidate must have deep understanding of the architectural and technical nuances of the complex transformation systems. Candidate must be able to work with the Business and cross-functions teams to convert the requiremen

Big Data Engineer

Judge Group, Inc.

Dallas, Texas, USA

Full-time

Location: Dallas, TX Description: Our client is currently seeking a Big Data Engineer Required Qualifications: 4+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education2+ years of technical leadership or architecture experience, in a data and technical environment2+ years of experience in Automation testing (Selenium/Karate/BDD)2+ years of experience in Performance testing

Cloudera Big Data Administrator

Zolon Tech Solutions Inc

Reston, Virginia, USA

Contract

Title : Cloudera Big Data Administrator Duration : 12 Months Location : Reston, VA (Hybrid) Job Description: This is a Cloudera Big Data administrator position and not a developer position. Experience with building Cloudera cluster CDP public cloud and AMI upgrade, setting up NiFi, SOLR, HBase, Kafka, Knox in Cloud using CDP Public Cloud v7.2.17 or higher. Be able to write the shell scripts to monitor the health check of services and respond accordingly to any warning or failure conditions. Moni

Big Data & Innovation Support Lead

SAIC

Washington, District of Columbia, USA

Full-time

Job ID: 2504113 Location: WASHINGTON, DC, US Date Posted: 2025-04-09 Category: Information Technology Subcategory: Big Data Engineer Schedule: Full-time Shift: Day Job Travel: Yes, 25 % of the Time Minimum Clearance Required: TS/SCI with Poly Clearance Level Must Be Able to Obtain: None Potential for Remote Work: Yes Description SAIC is seeking a Big Data & Innovation Support Lead to support a comprehensive technical modernization effort supporting DIA's intelligence mission in the Wa

Lead Big Data Engineer

Avance Consulting

Austin, Texas, USA

Full-time

Basic Qualifications At least 4 years of Information Technology experience3 years of experience in BI and Spark, Scala.Proficient in writing complex SQLs, expertise in performance tuning of SQLs.Proven experience in designing end-to-end reporting and dashboarding applications.Experience in designing and developing ETL data pipelines.Basic working knowledge of Python scripting and programming.Minimum of 1 year hands on experience in Snowflake database and table designGood communication and interp