big data Jobs in california

Refine Results
21 - 40 of 597 Jobs

Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem

TikTok

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : A114757 Apply to this job Share this listing: Responsibilities Team Introduction Our team plays a crucial role in the data ecosystem of the TikTok Recommendation System, focusing on creating offline and real-time data storage solutions for large-scale recommendation, search, and advertising businesses, serving over 1 billion users. The core goals of the team are to ensure high system reliability, uninterrupted service, and smooth da

Big Data Senior Manager - C13 - Hybrid

Citi

Remote or Tampa, Florida, USA

Full-time

The Big Data Sr manager is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. At least two years (Over all 10+ hands on Data Engineering experience) of experience building and leading highly complex, technical data engineering teams.Lead data engineering team, from sourcing to closing.

Lead Data Engineer - Big Data

S&P Consultants

Nevada, USA

Full-time

About the Role: Grade Level (for internal use): 12 About the Role: Title: Lead Data Engineer - Big Data The Team: You will be an expert contributor and part of the Rating Organization's Ingestion Pipelines Engineering Team. This team, who has a broad and expert knowledge on Ratings organization's critical data domains, technology stacks and architectural patterns, fosters knowledge sharing and collaboration that results in a unified strategy. All Data Services team members provide leadership

Big Data and Java Developer - Hybrid

Citi

Remote or Jersey City, New Jersey, USA

Full-time

Prime Service Tech is working on multi-year growth initiative and consent order data remediation deliverables and as part of it, we are expanding our platform offering to markets quants and product development to build analytics using Python, hosting new data platform, creating new data pipelines and building robust monitoring and observability capabilities for Prime Tech. The senior developer will work on building data pipelines, creating APIs to access data, working closely with product develo

Senior Big Data & Java Tech Lead Analyst - VP - Irving, TX/Tampa, FL

Citi

Remote or Irving, Texas, USA

Full-time

The Applications Development Senior Manager is a senior management level position responsible for accomplishing results through the management of a team or department in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to drive applications systems analysis and programming activities. Responsibilities: Manage one or more Applications Development teams in an effort to accomplish es

Compliance Program manager

Akshaya Inc

Remote

Third Party, Contract

Job Title: Compliance Program Manager Location: Remote Experience: 15 Years Required Description: What we are looking for 5+ years of information security, risk and/or compliance experience 5+ years of big data and/or cloud experience An effective technical communicator. Ability to design documentation structures that precisely communicate requirements, accountability, task assignment, status, progress towards milestones, and overall confidence in program deliverables across multiple teams. Anti

Data Engineer

Amiseq Inc.

San Jose, California, USA

Contract

Job Description: We are seeking a skilled Data Engineer with expertise in Big Data technologies to join our client in San Jose, CA. This role requires a long-term W2 contract and onsite presence 3 days per week. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL workflows.Work extensively with Big Data technologies including Hadoop, HDFS, Hive, and Spark SQL.Develop and optimize Python scripts for data processing and automation.Write and maintain Unix/Linux shell

Sr Data Engineer (Dbt, FiveTran,)

Critical River, Inc.

Pleasanton, California, USA

Full-time

Title: Sr Data Engineer (dbt, FiveTran, SQL,Google Cloud Platform) Location: Bay Area California (Hybrid) Duration: Fulltime with CR Years of Experience: 10-15 Years Job Description: A talented Senior Data Engineer to join our consulting practice. As a Senior Data Engineer, you will play a pivotal role in delivering data engineering solutions to our clients across various industries. You will work closely with clients to understand their business requirements, design and implement data solutio

Data Engineer

MARKS IT SOLUTIONS LLC

Sunnyvale, California, USA

Contract

Data EngineerLocation: Sunnyvale CAClient: WalmartW2 role Responsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancements to existing systems and parti

Data Pipeline Engineer

LowCountry Staffing & Consulting

Remote

Full-time

This position is 100% remote. No travel required. Design, develop and maintain manageable and scalable data pipelines and ETL processes to support data acquisition, integration and delivery for upstream applications, analytics, and other data-driven initiatives Design and implement advanced data storage solutions (databases, data warehouses, and data lakes) and efficient data transport layers (REST API s, message queues, message buses) Collaborate with executive leadership, product owners, tech

Databricks Architect

Showman Staffing

Remote

Contract

Databricks Architect Location: Remote US Job Type: Contract 6+ Months Experience Level: 10+ Years About the Role:-We are seeking an experienced Databricks Architect to lead the design and implementation of scalable data solutions across cloud platforms. This role demands strong technical leadership and hands-on expertise in Databricks, Apache Spark, and cloud data architecture (Azure or AWS). You will work closely with stakeholders to define data strategies, optimize performance, and ensure arch

Data Engineer III

OSI Engineering, Inc.

Sunnyvale, California, USA

Full-time

A globally leading tech company is seeking a Data Engineer with 6+ years of experience in software development and 3+ years in big data and data warehouse technologies (e.g., Trino, Spark, Snowflake). The role involves data modeling, database optimization, pipeline development, and full-stack integration using Java, Python, and SQL. If you're passionate about building scalable, data-driven solutions, we encourage you to apply! Job Responsibilities: Data Modeling and Database Design: Identifyi

Data Engineer experienced in RETAIL

Emonics LLC

Sunnyvale, California, USA

Contract

Key Responsibilities:Design and develop scalable data pipelines for large-scale processing and transformation. Integrate structured and unstructured data sources from various systems. Build, manage, and optimize data architectures to support business intelligence and analytics. Develop frameworks for data transformation, metadata management, dependencies, and workload orchestration. Collaborate with analysts, data scientists, and product teams to deliver timely and accurate data solutions. Requi

Data Engineer

Luxor Technology Corporation

Remote

Full-time

Company Background The Luxor team has built a range of solutions for Bitcoin mining and compute power, including a globally distributed mining pool, firmware, an ASIC brokerage desk, a data website and a Hashrate derivatives market. Our product suite is growing rapidly and as such we are looking to expand our product team. We fundamentally believe compute is going to be the world s most important commodity, and are building the infrastructure to support this new market. We are looking for a Data

ETL Backend SDET Dev Healthcare

Vega Consulting Solutions

Remote

Contract

Vega Consulting Solutions is Hiring! BACK END SDET QA Tester/Dev. for our direct Healthcare client. This is a remote based contract opportunity. Only Candidates located on the East Coast will be considered for this role. Candidates must have current experience working in Healthcare. Job Description:Responsible for developing, modifying, and executing software test plans, test scenarios, defines and solves for test data needs, automated scripts, and programs for testing in order to ensure the

Google Cloud Platform Data Engineer

Intellect Quest LLC

Remote

Contract, Third Party

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur

Lead Engineer/Architect- Cyber/Cloud

Radyant Inc.

Remote

Third Party, Contract

Lead Engineer/Architect- Cyber/Cloud Must have: Required TS/SCI with CI polygraphAWS Certified Solutions Architect or equivalent certification.Security+ certification and compliance with DoD 8570/8140 requirements.Qualifications: Minimum Education: Bachelor's in Computer Science, Engineering, or equivalent technical field (Master s preferred)Certifications: Recommended technical certifications in cloud, cybersecurity, or enterprise architectureExperience:10+ years of experience in IT system eng

Data Engineer, E-Commerce

TikTok

San Jose, California, USA

Full-time

Location : San Jose Employment Type : Regular Job Code : V0220 Apply to this job Share this listing: Responsibilities As a Data Engineer in the Data Platform E-Commerce team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of m

Druid Engineer

Biztec Global LLC

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in

Solo Full Stack Engineer

Motion Recruitment Partners, LLC

San Diego, California, USA

Full-time

Job Description This position is fully remote What if you could shape the technical foundation of an already-successful company-building out the entire engineering function while crafting tools that streamline and scale impact across campaigns, clients, and media platforms? That's the opportunity here. Our client is well-established in their industry and now looking to bring in their first engineering hire to lead the design and development of internal platforms from the ground up. If you're so