Spark Jobs

Refine Results
41 - 60 of 1,599 Jobs

Need - Postgress Architect |San Diego ,CA(Onsite)|12+months |Onsite |C2C - JJ

ASCII Group LLC

San Diego, California, USA

Contract, Third Party

Title : Postgress Architect Location : San Diego ,CA (Onsite) Duration : 12+ Months Rate : OPEN Visa Status : H1B,TN &E3 Relevant Experience (in Yrs.) : 12+ Role Description: We have an on premise database system in San Diego that houses a lot of key data for one our applications.We need to find a resource who could help bring up this on prem system, maintain it. Competencies: Digital : Apache Spark, Database Technology, Apache ServiceMix ESB Essential Skills: - Should have 10+ Years Exper

Data Engineer/Lead- need only 10+ years of experince

eTek IT Services, Inc.

Richmond, Virginia, USA

Third Party, Contract

Data Engineer 12+ months contract VA/CA/onsite 10+ years of Data engineerSpark, Scala, Kafka, big data strong AWS, S3, AWS Glue Python programing experience

Kubernetes Engineer

SSI People

Dallas, Texas, USA

Contract

Job Description: Kubernetes experience Image creation CI/CD pipeline knowledge Flex Skills/Nice to Have: Spark Trino Iceberg

Lead Big Data Engineer

Avance Consulting

Austin, Texas, USA

Full-time

Basic Qualifications At least 4 years of Information Technology experience3 years of experience in BI and Spark, Scala.Proficient in writing complex SQLs, expertise in performance tuning of SQLs.Proven experience in designing end-to-end reporting and dashboarding applications.Experience in designing and developing ETL data pipelines.Basic working knowledge of Python scripting and programming.Minimum of 1 year hands on experience in Snowflake database and table designGood communication and interp

Google Cloud Platform Data Architect / Engineer (Must work on W2)

Activesoft, Inc.

Remote

Contract

Required: Deep experienced data engineer/architect. Review ascend.io installation on Google Cloud Platform (Google Cloud Platform) Assess and give recommendations on best practices. Kubernetes, Spark, etc., are used by Ascend.io.

Palantir Ontology Data Engineer

Nava Software Solutions

Spring, Texas, USA

Contract, Third Party

NAVA Software is looking for a Palantir Ontology Data Engineer Details: Palantir Ontology Data Engineer Duration: 12 Months Location: Spring TX 5 day a week Interview mode: Video + Final F2F What role you will play in our team As part of the CCS100 Fusion Team, help build tools that optimize investment and operational decisions in the world-class, scalable carbon capture system Be a specialist in building and maintaining production-grade data pipelines, data connections, and ontologies wi

Senior General Data Architect

Amiseq Inc.

Remote

Contract

Job Description: * 15+ years in IT experience with a minimum 7+ Years of experience in data engineering, data platform, and analytics. * Projects delivered with hands-on experience in development on Databricks. * Working knowledge of any one cloud platform (AWS, Azure, or Google Cloud Platform). * Deep experience with distributed computing with Spark, including knowledge of Spark runtime internals. * Familiarity with CI/CD for production deployments. * Working knowledge of MLOps. * Current knowl

Data Engineer

Photon

Tampa, Florida, USA

Full-time

We're looking for a Data Engineer - Scala/Spark with deep expertise in big data processing and distributed systems to join our growing team! If you're passionate about building scalable data solutions and thrive in fast-paced environments, this could be the perfect opportunity. Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera H

Principal Data Engineer

EPSoft Technologies LLC

Austin, Texas, USA

Full-time

Role: Principal Data Enginner Locations: Austin, Tx & Fort Mill, SC Hybrid role/ Full Time We are looking for a skilled Principal Data Engineer to join our team and help build robust, scalable, and efficient data pipelines. The ideal candidate will have strong expertise in AWS, Python, Spark, ETL Pipelines, SQL, and Pytest. This role involves designing, implementing, and optimizing data pipelines to support analytics, business intelligence, and machine learning initiatives. Key Responsibil

Sr. Security Data Engineer

Factspan Inc

Remote

Full-time

Job Title: Sr. Security Data Engineer Location: Glendale.CA(Remote) 5 years of experience in information security and/or the following areas: security architecture, security engineering, production or network storage engineering, cybersecurity incident investigations, experience with cloud technologies. Advanced knowledge of cloud security and infrastructure environments for popular cloud providers (AWS, Azure, Google Cloud Platform)Broad technology expertise with application, system integration

Sr Java Developer

Virtual Networx

Toronto, Ontario, Canada

Full-time

Role: Senior Java Developer Location: Toronto, Canada Bachelor's Degree with specialized coursework in Computer Science or Management Information Systems Strong experience on Java/J2EE and Spring Boot, should be capable of programming in compiled and dynamic languages. Should have worked on Big Data and Hadoop platforms. Good understanding of Kafka Familiarity with Agile software development methodologies to ensure the early and continuous delivery of software Experience with Cassandra Modelling

Data Architect

IT-SCIENT

Santa Clara, California, USA

Full-time

Job Title: Data Architect Location: Santa Clara, CA Duration: Full Time Job Description: Master s or Bachelor s degree in Computer Science or Information System, or equivalent experience.8+ years of relevant experience including programming knowledge (i.e Python, SQL).5+ years of relevant experience in big data technologies and cloud platforms (i.e Spark, AWS).5+ years of relevant experience in data lake technologies (i.e Iceberg, Delta, Huidi).5+ years of experience in development best practic

Data Architect

Flexon Technologies Inc.

San Diego, California, USA

Contract, Third Party

Role : Data Architect Location: San Diego, CA (5 Days Onsite) Job type: Long Term Contract Role Description: We have an on-premises database system in San Diego that houses a lot of key data for one our applications.We need to find a resource who could help bring up this on prem system, maintain it.Should have 10+ Years Experience in Apache services like Spark.Should have 5+ years Experience in Apache Services like Parquet and Arrow.Must have expertise in designing databases, like an Architect.S

Lead Data Engineer

Incedo Inc

Atlanta, Georgia, USA

Full-time

Lead Data Engineer Role Overview: We are seeking a Lead Data Engineer with expertise in data modeling, Data Vault architecture, and cloud data warehouse (CDW) architecture utilizing the Kimball model. The ideal candidate will have hands-on experience with data fabric technologies (e.g., Databricks), Spark, and Python on Azure Cloud. This role involves designing, implementing, and optimizing data pipelines and data platforms to support business intelligence and advanced analytics. Key Responsibil

Senior Big Data Engineer - Location preference NC

Techmatic Inc

Charlotte, North Carolina, USA

Third Party, Contract

Senior Big Data Engineer - Prefer Locals to Charlotte Required Skills Scala PySpark Spark Google Cloud Platform (DataProc/Composer/BQ) Airflow Grafana 10+ years of Data Engineering 8+ years of PySpark/Scala 7 years of Scala 5+ years of experience hosting application on Google Cloud Platform

Senior Data Engineer - Databricks

Go2Group Inc.

New York, New York, USA

Contract

**Nosponsorshipavailable.Pleaseno3rdpartysubmissions** Ready to do some interesting, gratifying, and impactful work with Databricks? Seeking a Senior Data Engineer with strong Databricks expertise to join our Data Analytics & AI team. You ll partner with clients to build scalable cloud and data engineering solutions that deliver real business value. Key Points: 6-month contract-to-hire (Although FTE hires are the preference, this particular role due to current constraints and approvals for h

DATA ARCHITECT

Siri Infosolutions Inc

Santa Clara, California, USA

Full-time

Job Title: Data Architect Location: Santa Clara, CA (Onsite) Fulltime/Permanent Job Description: What you'll be doing: Build data pipelines to transport data from a data source to the data lake. Build data systems and pipelines ensuring that data sources, ingestion components, validation functions, transformation functions, and destination are well understood for implementation. Develop and implement the new End-to-End Data systems for our Planning, Logistics and Services initiatives. Prepare d

Data Architect

Happiest Minds Technologies Limited

Atlanta, Georgia, USA

Contract, Third Party

Data ArchitectAtlanta, GA (Onsite) Key Responsibilities: Design and develop scalable, robust, and high-performance data & platform architectures using Azure and Databricks.Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.Lead the design and implementation of data models, data warehouses, data lakes and lakehouse with batch and streaming dataEnsure data quality, integrity, and security across all data platforms.Optimize data s

AI/ML Engineer

Zenox Global, LLC

Arlington, Texas, USA

Full-time

Title- AI/ML Engineer Location- Arlington, Texas- USA (Day 1 Onsite) Type- Full-Time/Direct Hire Key Responsibilities AI Model Development: Design, develop, and deploy machine learning models and AI solutions to solve complex problems. Data Analysis and Preprocessing: Collect, preprocess, and analyze large datasets to train and evaluate AI models. Performance Monitoring: Monitor the performance of AI models, troubleshoot issues, and optimize algorithms for efficiency and accuracy. Collaboration

Big Data Engineer

Skillify Solutions

Remote or Hoboken, New Jersey, USA

Contract

Urgent req- Big data engineer - Delloite- Have interview slots- Remote Job Title - Big Data Developer Location Remote + Travel 2 days local Deloitte office/Week Duration: 6 months Job Description: Big Data Developer - Minimum 6 yrs of experience in Cloud, Big Data, Spark & Scala - Must have skill : Experience in Spark and Scala with exposure about cloud platforms ( AWS, Azure, Google Cloud Platform) for big data processing and storage - Strong experience in Azure DLS - Strong experience in Data