spark Jobs

Refine Results
41 - 60 of 1,587 Jobs

Data Engineer with Google Cloud Platform

American IT Systems

Sunnyvale, California, USA

Contract, Third Party

Role :: Data Engineer with Google Cloud Platform 13+ years Location: This is based out of CA and candidate is expected to be in office from day 1 Onsite Requirement Yes Sunnyvale, CA (On-Site) Duration : 12+ Months Contract Must have skills. Scala Python Google Cloud Platform Spark Cloud Services(Google Cloud Platform) Retail (preferred) Airflow UST Global is looking for a highly energetic and collaborative Data Engineer for a 12-month engagement. Responsibilities: As a Senior Data Engineer

Principal Data Engineer

EPSoft Technologies LLC

Austin, Texas, USA

Full-time

Role: Principal Data Enginner Locations: Austin, Tx & Fort Mill, SC Hybrid role/ Full Time We are looking for a skilled Principal Data Engineer to join our team and help build robust, scalable, and efficient data pipelines. The ideal candidate will have strong expertise in AWS, Python, Spark, ETL Pipelines, SQL, and Pytest. This role involves designing, implementing, and optimizing data pipelines to support analytics, business intelligence, and machine learning initiatives. Key Responsibil

Data Engineer

Photon

Tampa, Florida, USA

Full-time

We're looking for a Data Engineer - Scala/Spark with deep expertise in big data processing and distributed systems to join our growing team! If you're passionate about building scalable data solutions and thrive in fast-paced environments, this could be the perfect opportunity. Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera H

Sr Java Developer

Virtual Networx

Toronto, Ontario, Canada

Full-time

Role: Senior Java Developer Location: Toronto, Canada Bachelor's Degree with specialized coursework in Computer Science or Management Information Systems Strong experience on Java/J2EE and Spring Boot, should be capable of programming in compiled and dynamic languages. Should have worked on Big Data and Hadoop platforms. Good understanding of Kafka Familiarity with Agile software development methodologies to ensure the early and continuous delivery of software Experience with Cassandra Modelling

Data Architect

Flexon Technologies Inc.

San Diego, California, USA

Third Party, Contract

Role : Data Architect Location: San Diego, CA (5 Days Onsite) Job type: Long Term Contract Role Description: We have an on-premises database system in San Diego that houses a lot of key data for one our applications.We need to find a resource who could help bring up this on prem system, maintain it.Should have 10+ Years Experience in Apache services like Spark.Should have 5+ years Experience in Apache Services like Parquet and Arrow.Must have expertise in designing databases, like an Architect.S

Lead Data Engineer

Incedo Inc

Atlanta, Georgia, USA

Full-time

Lead Data Engineer Role Overview: We are seeking a Lead Data Engineer with expertise in data modeling, Data Vault architecture, and cloud data warehouse (CDW) architecture utilizing the Kimball model. The ideal candidate will have hands-on experience with data fabric technologies (e.g., Databricks), Spark, and Python on Azure Cloud. This role involves designing, implementing, and optimizing data pipelines and data platforms to support business intelligence and advanced analytics. Key Responsibil

Senior Big Data Engineer - Location preference NC

Techmatic Inc

Charlotte, North Carolina, USA

Third Party, Contract

Senior Big Data Engineer - Prefer Locals to Charlotte Required Skills Scala PySpark Spark Google Cloud Platform (DataProc/Composer/BQ) Airflow Grafana 10+ years of Data Engineering 8+ years of PySpark/Scala 7 years of Scala 5+ years of experience hosting application on Google Cloud Platform

DATA ARCHITECT

Siri Infosolutions Inc

Santa Clara, California, USA

Full-time

Job Title: Data Architect Location: Santa Clara, CA (Onsite) Fulltime/Permanent Job Description: What you'll be doing: Build data pipelines to transport data from a data source to the data lake. Build data systems and pipelines ensuring that data sources, ingestion components, validation functions, transformation functions, and destination are well understood for implementation. Develop and implement the new End-to-End Data systems for our Planning, Logistics and Services initiatives. Prepare d

Senior Data Engineer - Databricks

Go2Group Inc.

New York, New York, USA

Contract

**Nosponsorshipavailable.Pleaseno3rdpartysubmissions** Ready to do some interesting, gratifying, and impactful work with Databricks? Seeking a Senior Data Engineer with strong Databricks expertise to join our Data Analytics & AI team. You ll partner with clients to build scalable cloud and data engineering solutions that deliver real business value. Key Points: 6-month contract-to-hire (Although FTE hires are the preference, this particular role due to current constraints and approvals for h

Data Architect

Happiest Minds Technologies Limited

Atlanta, Georgia, USA

Contract, Third Party

Data ArchitectAtlanta, GA (Onsite) Key Responsibilities: Design and develop scalable, robust, and high-performance data & platform architectures using Azure and Databricks.Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.Lead the design and implementation of data models, data warehouses, data lakes and lakehouse with batch and streaming dataEnsure data quality, integrity, and security across all data platforms.Optimize data s

Sr Data Engineer

V2 Innovations Inc

Michigan, USA

Full-time

Looking for multiple positions in Canton, MI Company: V2 Innovations Inc Location: 42180 Ford Rd, STE#302, Canton, MI 48187. E-Mail: Willing to travel/relocate to various client locations in the US. Sr Data Engineer: Design and development of end-to-end data pipelines/including modelling and transformation of data/ensuring data quality and governance, monitor and optimize performance. Tools/Tech: Python/SQL/Azure cloud/Spark. Req: BS in Computers/IT/related field. Exp: 5yrs as Sr. Data eng

AI/ML Engineer

Zenox Global, LLC

Arlington, Texas, USA

Full-time

Title- AI/ML Engineer Location- Arlington, Texas- USA (Day 1 Onsite) Type- Full-Time/Direct Hire Key Responsibilities AI Model Development: Design, develop, and deploy machine learning models and AI solutions to solve complex problems. Data Analysis and Preprocessing: Collect, preprocess, and analyze large datasets to train and evaluate AI models. Performance Monitoring: Monitor the performance of AI models, troubleshoot issues, and optimize algorithms for efficiency and accuracy. Collaboration

Senior Data Engineer

HMG America

Dallas, Texas, USA

Full-time, Contract

HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for Senior Data Engineer in Dallas, TX. Below is the detailed job description. Role - Senior Data Engineer Location - Dallas, TX (Hybrid, 3 days/week) Mode - FTE and Contract Must Have - Databricks , Azure Data Factory , Spark Job Description Required Skills/Q

Senior Java Backend Developer

Brilliant Infotech Inc.

Jersey City, New Jersey, USA

Contract

Senior Java Backend DeveloperJersey City NJ Job Description:Sr. Java Developer with back end services development experience.Looking for a senior Java Developer with spring boot experienceAny knowledge of Spark will be added advantage

Hadoop developer

Collabera LLC

Jersey City, New Jersey, USA

Full-time

Description: Characteristics of a top performer: Strategically architect, design, develop and implement efficient BigData programs and initiatives. Always eager to learn more.Education Requirements: Bachelor s in Computer Science with 8 years or Master s in Computer Science with 6 years of relevant experienceDeal Breaker Items: If the resource is not hands on technicallyScope of work:Understand business requirements , study existing application landscape, and conceptualize technical solutions to

Data Engineer

Ajace Inc

Arlington, Virginia, USA

Full-time

Key Responsibilities and Essential Duties: Build complex data solutions in an Azure Cloud environment.Maintain the Azure components and services.Develop architecture changes using infrastructure as code.Create data architectures diagrams for complex data modeling solutions.Create and maintain data dictionaries for contextualizing data from disparate sources.Enable end-to-end automation for deployment using continuous integration and continuous delivery.Implement data pipelines to ingest data to

Senior Data Engineer

Symantrix Inc

California, USA

Contract

Description: What you'll do: You will use cutting edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on. You will be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed way

Hadoop Developer with java background

ProCorp Systems Inc.

Atlanta, Georgia, USA

Contract

Position: Hadoop Developer with java background Location: Alpharetta, GA Duration: 12+ Months Responsibilities Programming Languages: Strong proficiency in Python, Java, and SQL. Big Data Frameworks: Deep understanding of Hadoop ecosystem (HDFS, MapReduce, Hive, Spark). Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation, and query optimization. Data Engineering Concepts: Knowledge of data ingestion, transformation, data quality checks, and data security practices.

Big Data Principal Architect

Heliogic LLC

Remote

Full-time

Role: Big Data Principal Architect Location: Remote Job type :Full time Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Client Relationship, Presentation. Years Of Experience15 to 20 Years Job Description Handson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of b

Data Architect

Nityo Infotech Corporation

Santa Clara, California, USA

Full-time

What you'll be doing: Build data pipelines to transport data from a data source to the data lake. Build data systems and pipelines ensuring that data sources, ingestion components, validation functions, transformation functions, and destination are well understood for implementation. Develop and implement the new End-to-End Data systems for our Planning, Logistics and Services initiatives. Prepare data for prescriptive and predictive modeling by making sure that the data is complete, has been cl