apache spark Jobs in portland, or

Refine Results
1 - 20 of 306 Jobs

Lead Apache Spark Developer

Everest Global Solutions

•

Remote

Full-time

Role: Lead Apache Spark Developer Location: Remote Duration: long term Contract: C2C Required experience: 10+ years Job Summary: We are looking for a skilled Apache Spark Developer to join our Big Data team. The ideal candidate will have hands-on experience in building scalable and efficient data processing pipelines using Spark and related big data technologies. Key Responsibilities: Design, develop, and optimize large-scale data processing pipelines using Apache Spark.Work with big data platfo
Easy Apply
Posted 2 days ago

Jr. Data Engineer (Langchain, Spark) - Remote

ConsultNet, LLC

•

Remote or South Jordan, Utah, USA

Full-time

Title: Jr. Data Engineer, Healthcare Location : 100% Remote Target Start Date : ASAP Type: contract or contract to hire Pay Rate: DOE Are you driven by working to improve our healthcare system through advanced technology? We need your expertise and integrity! This role is 100% remote and we are looking for candidates who have healthcare domain expertise. Responsibilities Design, maintain, and execute intermediate-to-advanced Apache Spark jobs (using RDDs, DataFrames, Datasets, and Structur
Easy Apply
Posted 22 days ago | Updated 7 hours ago

Java Spark Developer - AVP

Citi

•

Remote or Jersey City, New Jersey, USA

Full-time

Seeking a Spark Java Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems. This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting . Key responsibilities Develop and optimize scalable Spark Java-based data pipelines for processing and an
Posted 12 days ago | Updated 19 hours ago

Senior java developer with Spark - VP - TAMPA

Citi

•

Remote or Tampa, Florida, USA

Full-time

The Java Applications Developer with Spark is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities: Lead integration of functions to meet goals, deploy new products, and enhance processesAnalyze complex business processes, system processes, and industry standards to defi
Posted 60+ days ago | Updated 19 hours ago

Data Engineer - Scala

Exl Service

•

Remote

Full-time

We will only be able to move forward with candidates who have ship or hold active s for this role What you'll Do: Create and maintain optimal data pipeline architectureBuild data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysisAssemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-des
Easy Apply
Posted 23 days ago | Updated 23 days ago

Data Engineer

Innova Solutions, Inc

•

Remote

Contract

Let Volt help move you forward Volt is immediately hiring for Data Engineer in Remote As a Data Engineer, you will: Key responsibilities: Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects.Develop, implement, and deploy ETL solutions.Preprocess and analyze large datasets to identify patterns, trends, and insights.Evaluate, validate, and optimize data models to ensure efficiency, and generaliza
Easy Apply
Posted 3 days ago

Databricks Architect

Amiseq Inc.

•

Remote

Contract

Job Title: Databricks Architect Duration: 12 months Location: Remote Skills Required: Architecting and Leadership:Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.Data Engineering:Strong programming experience in Python; Scala is a significant plus.Proficiency in complex query tuning.Experience building Slowly Changing Dimensions (SCD) TYPEs.Familiarity with DBT.Experience with structured streaming.Knowledge of data formats like Iceberg
Easy Apply
Posted 11 days ago

Data Architect V

Aditi Consulting

•

Remote or San Jose, California, USA

Contract

Payrate: $63.74- $63.74/hr. Summary: As a Data Engineer, you will be responsible for designing and implementing data pipelines and architectures that support the collection, transformation, and analysis of data. You will work closely with our Technology and Products Teams to ensure data understanding, security methods assigned and accessibility. Key Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines using Python, SQL, and SPARK/SPARK SQL to ensure efficient d
Easy Apply
Posted 17 days ago | Updated moments ago

Microsoft Fabric

Dyota Tech Solutions

•

Remote

Contract

Job title MS Fabric Location: 100% remote Duration : Contract Required Skills and Experience: Minimum 8 + years technology experience, preferably in the Microsoft spaceProven experience in designing enterprise-scale data architectures using Microsoft Fabric5 + years experience of Azure SynapseDeep understanding of Microsoft Fabric ecosystem.5 + years experience of ETL/ELT tools, Spark, KQL, and SQL-based data warehousing.5 + years experience with Power BI, particularly DirectLake capabilities
Easy Apply
Posted 24 days ago

Pre-Sales Technical Architect

MSquare Systems Inc.

•

Remote

Full-time

Position: Remote & Full-Time Key Responsibilities: Solution Architecture & Implementation Design scalable and secure end-to-end data pipeline architectures across cloud-native platforms (AWS, Azure)Build and demonstrate technical solutions using Databricks, Snowflake, Informatica, AWS Glue, etc.Integrate data validation and observability tools such as Great Expectations, Monte Carlo, or DataGapsOptimize pipeline performance, cost-efficiency, and data governance frameworks across diverse environm
Easy Apply
Posted 4 days ago | Updated 2 days ago

AIOps Google Cloud Platform Engineer/Architect

DynPro Inc.

•

Remote

Full-time

About the Role: As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimize intelligent automation solutions for IT operations, ultimately improving the experience for our global customers. This position offers a unique opportunity to work on challenging problems at scale, contribut
Easy Apply
Posted 11 days ago

Google Cloud Platform Data Engineer

Intellect Quest LLC

•

Remote

Third Party, Contract

Role : Google Cloud Platform Data EngineerLocation: Remote Description: We are seeking a highly motivated and talented Data Engineer to join our dynamic team. As a Data Engineer, you will play a critical role in designing, developing, and implementing data pipelines and data integration solutions using Spark, Scala, Python, and Google Cloud Platform (Google Cloud Platform). You will be responsible for building scalable and efficient data processing systems, optimizing data workflows, and ensur
Easy Apply
Posted 18 days ago

Senior SQL Server Database Developer

Fisher Investments

•

Camas, Washington, USA

Full-time

Overview It's an exciting time to be a member of the Fisher Investments Technology Department. We're investing in the future of our firm's technology and are building our team to achieve global growth. We are looking for a Senior Data Engineer to support our Corporate Systems team. If you are looking for an opportunity to make a difference as we develop scalable and strategic solutions to support our global growth, we want to hear from you! The Opportunity: The Senior Data Engineer is the ent
Posted 12 days ago | Updated 3 hours ago

Data Engineer

Vaco by Highspring

•

Remote

Contract

Vaco is on the search for a key client as they build out their data engineering team. In this role,as a Data Engineer, your primary responsibility will be to lead the design, development, and implementation of data solutions while driving strategic initiatives across the enterprise. We are looking for a strong background with Azure Data Factory, Kafka, Snowflake, SQL and ETL processes. You will assist with data warehousing architecture design and strategies for data replication, governance, obse
Easy Apply
Posted 17 days ago | Updated 2 days ago

Druid Engineer

Biztec Global LLC

•

Remote

Full-time

Data Engineer, Distributed Systems Druid Engineer Remote or Austin, Texas KEY RESPONSIBILITIES Design and Development:o Design and implement data ingestion pipelines to load data into Apache Druid.o Develop and optimize Druid schemas and data models for efficient querying and performance.o Design and implement data aggregations against event-level data in distributed database (preferably in Druid)o Migration from existing data stores to Druid Optimization:o Implement best practices for data in
Easy Apply
Posted 10 days ago

Machine Learning Engineer | Only W2

TekDallas

•

Remote

Contract

Position: Machine Learning Engineer Location: 100% Remote (EST time zone) Duration: 12 Month Contract Only W2 Qualifications: 10+ years of IT experience and at least 5+ years working as a Machine Learning EngineerMust have strong programming skills in PythonExperience with both RDBMS and NoSQL databases (e.g., MongoDB, BigQuery)Hands-on experience with data preprocessing, feature engineering, and model evaluationExperience working with cloud platforms, especially Google Cloud Platform (Googl
Easy Apply
Posted 4 days ago | Updated 2 days ago

ETL Developer

Raas Infotek LLC

•

Remote or Austin, Texas, USA

Contract

Position: ETL DeveloperContract: W2 Only Responsibilities:Design, develop, and maintain scalable ETL pipelines to support data integration and backend services for mobile and enterprise applications.Collaborate with Android/mobile development teams to understand data needs for performance monitoring, analytics, and reporting.Build and maintain data workflows that connect to APIs, GraphQL, and RESTful services to extract, transform, and load data from diverse sources.Develop efficient ETL solutio
Easy Apply
Posted 2 days ago

AIOps Google Cloud Platform Engineer - W2

DynPro Inc.

•

Remote

Contract

ONLY W2 Role: AIOps Google Cloud Platform Engineer Location: Remote, USA Duration: 12-month contract About the Role: Google Cloud is at the forefront of innovation, empowering businesses with cutting-edge cloud technologies. As an AIOps Engineer, you will play a critical role in enhancing the reliability, efficiency, and performance of Google Cloud's vast and complex infrastructure. You will leverage your expertise in Artificial Intelligence and Machine Learning to design, implement, and optimi
Easy Apply
Posted 16 days ago | Updated 1 day ago

AI/ML Engineer

Universal Business Consulting

•

Remote

Contract

Contract- 12 Months We are seeking an experienced data scientist with expertise in AIOps and IT Operations to spearhead our Event Management Program. The ideal candidate will possess a deep understanding of data analytics, machine learning algorithms, and IT operations to help automate and optimize our event correlation and incident response systems. What Our AIOps Team Does: We integrate data from various monitoring platforms to achieve a comprehensive view of our IT environment.We harness the
Easy Apply
Posted 5 days ago | Updated 3 days ago

Data Engineering Manager - Security

Netflix, Inc.

•

Remote

Full-time

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. Securing our members' data and accounts appropriately is key to maintaining a high level of trust with our customers. In addition, securing our technology infrastructur
Posted 8 days ago | Updated 7 hours ago