Pyspark jobs in costa mesa, ca

Senior Data Software Engineer with AWS, LLM, PySpark

Remote

•

Today

We are seeking a highly motivated Senior Data Software Engineer to design, build, and maintain modern cloud-based data platforms while enabling the next generation of AI and Copilot solutions. The ideal candidate will have strong expertise in AWS data ecosystems, PySpark, and experience developing AI-powered solutions using large language models and Generative AI applications. Responsibilities Design and implement scalable ETL/ELT pipelines Build and optimize data ingestion frameworks from APIs,

Full-time

AWS Senior Data Engineer

Hybrid in Torrance, California

•

2d ago

We are looking for a Senior AWS Data Engineer to design, develop, optimize, and support enterprise data pipelines and data integration solutions. Required Skills: 5+ years of Data Engineering, ETL, database, and data warehousing experienceStrong hands-on experience with AWS Glue, EMR, S3, Redshift, RDS, Athena, and Airflow/MWAAStrong PySpark, Apache Spark, and Python experienceExperience with Apache Iceberg and data lake/lakehouse architectures2+ years of CI/CD experienceExperience designing, mo

Easy Apply

Contract

Depends on Experience

Senior Architect- Data Engineering

Tustin, California

•

Today

Location: Tustin, CA Salary: $200,000.00 USD Annually - $220,000.00 USD Annually Description: Senior Architect- Data Engineering Irvine, CA Fulltime Role Overview We are seeking a visionary and hands-on Senior Data Engineering Architect to design, scale, and optimize our enterprise data platform. In this role, you will define the blueprints for our data estate, leveraging a modern stack centered on Databricks, dbt, and Apache Airflow. You will bridge the gap between complex business strategy a

Full-time

USD 200,000.00 - 220,000.00 per year

Data Scientist - Business Analytics & ML

Irvine, California

•

Today

At Kia, we're creating award-winning products and redefining what value means in the automotive industry. It takes a special group of individuals to do what we do, and we do it together. Our culture is fast-paced, collaborative, and innovative. Our people thrive on thinking differently and challenging the status quo. We are creating something special here, a culture of learning and opportunity, where you can help Kia achieve big things and most importantly, feel passionate and connected to your

Full-time

USD 89,936.00 - 121,409.00 per year

Senior Data Engineer

Costa Mesa, California

•

Today

Anduril Industries is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century's most innovative companies to the defense industry, Anduril is changing how military systems are designed, built and sold. Anduril's family of systems is powered by Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and c

Full-time

USD 166,000.00 - 220,000.00 per year

Data Platform Engineer

Remote or Toronto, Ontario

•

Today

Job Title: Data Platform Engineer Location: Remote (Canada) Employment Type: Full-Time Contract Job Summary We are seeking an experienced Data Platform Engineer to design, build, and enhance a cloud-native data platform on AWS and Snowflake. The ideal candidate will have strong expertise in data ingestion, transformation, orchestration, metadata management, and data quality, while building scalable and reliable data pipelines that support enterprise analytics and reporting. Key Responsibiliti

Easy Apply

Third Party, Contract

Azure Data Architect

Remote

•

4d ago

Sr. Data Architect- Remote- US, Canada, LATAM location are all ok We are seeking a highly skilled and experienced Sr Data Architect to join our team. As a Sr Data Architect, you will be responsible for designing, implementing, and managing data architecture on cloud platforms for our clients. Your expertise will play a critical role for our clients in shaping data strategy, ensuring efficient data integration, storage, and accessibility while maintaining data security and compliance. Key Respons

Easy Apply

Full-time

$180,000 - $190,000

AWS Senior Data Engineer

California

•

Today

Location: Los Angeles area (4 days a week) W2 Candidates only Long-term contract Job Description We are seeking a Data Engineer with 5+ years of experience in data engineering, ETL, data warehousing, and database design. The ideal candidate will have strong hands-on experience with AWS data services, PySpark/Spark, Python, Airflow, and Redshift, with a focus on designing, developing, optimizing, and supporting scalable data pipelines. Key Responsibilities Data Integration & Pipeline Developme

Full-time

Palantir Forward Deployed Engineer

Remote

•

2d ago

JOB DETAILS: Job Title: Palantir Forward Deployed Engineer Location: 100% Remote Contract Duration: 06 plus months contract with extensions (long -term contract) Job Description: Key Responsibilities Technical Leadership & Architecture Design, build, and deploy end-to-end data integration pipelines using Palantir Foundry, including complex transforms, incremental pipelines, and multi-source data connectorsArchitect and maintain the Ontology layer defining object types, link types, action typ

Easy Apply

Contract

$90 - $114

System Development Engineer

Remote

•

5d ago

Position: System Development EngineerLocation: RemoteThe common nature of the work:Every one is a System Development Engineer (Contractor) position, Seattle-based, L5L6 equivalent, 1 opening each, sitting on the Region Flexibility Migration (RFM) team inside the clients Intelligent Cloud Hosting (ICON) organization. They all serve a single 2026 initiative: DRAM (memory) footprint reduction across the clients production service fleet essentially cost/efficiency and performance engineering, not n

Easy Apply

Contract

Depends on Experience

Databricks Engineer (W2 only)

Remote

•

2d ago

Role: Databricks Engineer Duration: 6+ months contract Location:100% Remote Position details Required Skills: Proficiency in PySpark and SQL, experience with Medallion architecture, and performance tuning within the Databricks Lakehouse platform. Set up row/column-level security and manage data lineage and sharing in Unity Catalog. Utilize CI/CD and testing processes like Databricks. Utilize CI/CD and testing processes like Databricks. Preferred Skills: SAS, SQL, Unix, Linux Education: Bachel

Easy Apply

Contract

Depends on Experience

Principal, Data Engineer

Irvine, California

•

Today

At Cotality, we are driven by a single mission-to make the property industry faster, smarter, and more people-centric. Cotality is the trusted source for property intelligence, with unmatched precision, depth, breadth, and insights across the entire ecosystem. Our talented team of 5,000 employees globally uses our network, scale, connectivity and technology to drive the largest asset class in the world. Join us as we work toward our vision of fueling a thriving global property ecosystem and a mo

Full-time

USD 154,600.00 - 195,000.00 per year

Senior Fabric ETL Developer

Remote

•

23d ago

Title: Senior Fabric ETL Developer Location: Remote Contract SUMMARY:Our client would like us to provide them with a Senior Developer with extensive experience in Microsoft Fabric, specializing in Lakehouse-based data processing and Fabric Notebooks utilizing PySpark. This role focuses on transforming curated Lakehouse data into standardized and custom text file extracts (e.g., CSV, TXT, pipe-delimited) for secure delivery to external vendors and partners. Additionally, the Developer will part

Easy Apply

Contract, Third Party

Depends on Experience

Databricks developer

Remote

•

2d ago

Required Skills 10+ years of experience with Databricks. Strong experience in PySpark, Spark SQL, and Python. Hands-on experience with Delta Lake and Databricks Workflows. Strong SQL and data modeling skills. Experience with Azure Databricks or AWS Databricks. Knowledge of Azure Data Factory (ADF), ADLS Gen2, or AWS S3. Experience with Git, Azure DevOps, or Jenkins. Understanding of data warehousing concepts and ETL best practices. Preferred Skills Experience with Unity Catalog, MLflow, and Delt

Easy Apply

Contract

50+

Lead Microsoft Fabric Architect & Administrator

Remote

•

11d ago

Job Title: Lead Microsoft Fabric Architect & Administrator Work Location: 100% Remote Long Term Contract If you find this opportunity suitable, kindly share your updated resume. Also, please let me know a good time to connect with you for a quick discussion. Looking forward to hearing from you! Job Description We are seeking a visionary Microsoft Fabric Architect & Administrator to lead our transition into a unified, AI-ready data ecosystem. In this role, you will be the primary owner of our Mi

Easy Apply

Full-time

Depends on Experience

10607 - Senior Data Engineer (Python)

Irvine, California

•

Today

10607 - Senior Data Engineer Location: Irvine, CA Company Overview Hyundai AutoEver America (HAEA) is the dynamic IT powerhouse behind Hyundai Motor Corporation, a Fortune 500 global leader in the automotive industry. As a key affiliate, we provide cutting-edge IT services and support to top brands including Kia, Genesis, Hyundai Translead, Hyundai Mobis, Hyundai Capital, and Glovis. HAEA offers a truly global and collaborative environment. Here, you'll drive innovation, boost operational eff

Full-time

USD 96,550.00 - 138,061.00 per year

Lead Data Engineer (Azure, Snowflake, DB) !!! Remote

Remote

•

4d ago

Role: Lead Data Engineer (Azure, Snowflake, DB) Location: Remote Duration: Long Term Skill Focus Azure , Snowflake, DB, ETL, Python, Pyspark, SnowSQL Key Responsibilities: Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT. Build and maintain data integration workflows from various data sources to Snowflake. Write efficient and optimized SQL queries for data extraction and transformation. Work with stakeholders to understand business requirements and translate t

Easy Apply

Contract

Depends on Experience

Multiple Databricks Positions

Remote

•

4d ago

Location: Nationwide United States Employment Type: W2 Only C2C: Not Available Job Description CodeForce 360 is hiring Databricks professionals for multiple positions with our Fortune 1000, system integrator, and enterprise clients across the United States. Opportunities may be available onsite, hybrid, or remote, depending on client requirements. We are seeking candidates with knowledge or experience across various Databricks technologies, modules, and cloud environments. Posit

Easy Apply

Full-time, Third Party

$50 - $150

AWS Senior Data Engineer

Torrance, California

•

Today

Description We are looking for an AWS Senior Data Engineer to join a long-term contract opportunity supporting data initiatives within the automotive industry in Southern California. In this role, you will build and enhance cloud-based data pipelines that power analytics, reporting, and operational decision-making. The position requires strong hands-on experience with AWS data services, scalable processing frameworks, and modern engineering practices to deliver reliable and efficient data soluti

Easy Apply

Contract

USD 63.00 - 67.00 per hour

Data Analytics Technical Lead with Power BI

Remote

•

23d ago

Holds Databricks Certified Data Engineer Professional certification along with strong expertise across modern analytics ecosystems and cloud-native data platforms. Data Analytics Technical Lead with extensive hands-on experience in Databricks, including advanced data engineering, lakehouse architecture, and performance optimization, supported by relevant Databricks certifications. Proven expertise leading enterprise-scale analytics initiatives across modern cloud and big data platforms. Well-rou

Easy Apply

Full-time

Depends on Experience

Pyspark jobs in Costa Mesa, CA, USA