Hadoop PySpark Data Pipeline Build Engineer Jobs in Portland, OR

Refine Results
81 - 100 of 100 Jobs

Software Engineer-Data Engineering

American Association Of Motor Vehicle Admin.

•

Remote or Arlington, Virginia, USA

Full-time

Position Summary: The IT Division is responsible for the development and operations of information systems for the State and Federal agencies doing business related to or using information from the administration of motor vehicles and driver licenses. The Data Engineer position has core responsibilities for the design, development, maintenance, optimization, and operational support of components which move and ingest data from sources into the analytics systems. Essential Duties and Responsibi
Posted 60+ days ago | Updated 31 days ago

Kafka Engineer

iQuest Solutions Corp

•

Remote or US

Contract, Third Party

Kafka Engineer Remote Job Description Experience with Big Data solutions such as Cassandra, Google Pub/Sub, Hadoop, Spark, Kafka, ElasticSearch and Solr is a plus; Working knowledge and experience of Bitbucket, Git or Gitflow; Continuous integration and automated testing; Knowledge of Kafka Schemas and use of the Schema Registry; Strong fundamentals in Kafka client configuration and troubleshooting; Development of RESTful Services employing Spring and Spring Boot frameworks; Building Cloud Nat
Easy Apply
Posted 60+ days ago | Updated 21 days ago

AWS Data Engineer : Only W2 : Remote

Rudratek Solutions Pvt. Ltd.

•

Remote

Full-time

Job Title : AWS Data Engineer Exp : 10 Years Location : Remote Job type : W2 Only Detailed Job Description: We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep understanding of data transformation and the ability to
Easy Apply
Posted 16 days ago

AWS Glue Big data engineer

System Soft Technologies

•

Remote

Contract

System Soft Technologies is widely recognized for its professionalism, strong corporate morals, customer satisfaction, and effective business practices. We provide a full spectrum of business and IT services and solutions, including custom application development, enterprise solutions, systems integration, mobility solutions, and business information management. System Soft Technologies combines business domain knowledge with industry-specific practices and methodologies to offer unique solution
Easy Apply
Posted 8 days ago

Sr. Data Platform Engineer(Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigm) : Princeton NJ

Yashco Systems, Inc.

•

Remote or Princeton, New Jersey, USA

Contract

Sr. Data Platform Engineer Location: Princeton NJ Duration: 6 months Sr. Data Platform Engineer Design and implement Azure cloud-based Data Warehousing and Governance architecture with Lakehouse paradigmIntegrating technical functionality, ensuring data accessibility, accuracy, and security.Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces.Define and organize data assets (structured and unstructured
Easy Apply
Posted 7 days ago | Updated 7 days ago

Azure Data Engineer

APLOMB Technologies

•

Remote

Contract

Role: Azure Data Engineer Exp: 15+ Location: Remote Client: KFROCE / WOOLBRIGHT Visa: / // / L2S JD: Requirements: - Minimum of 15 years of experience in data engineering, with at least 5 years focus on Azure technologies. - Strong expertise in designing and implementing data solutions using Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other relevant Azure services. - Proficiency in programming languages such as Python, Java, or C#. - Solid understanding of data modelling,
Easy Apply
Posted 10 days ago | Updated 8 days ago

Bigdata Hadoop Engineer

Softsol Resources Inc

•

Remote or California City, California, USA

Contract

Please send me your resume to if you are interested and can be able to work on W2. Need local to California Job Title: Hadoop Engineer- CR243 Location: Remote but looking local to California. Duration : Long Term Job Description: MUST Have SKILLS. Strong project experience in Big Data, Cloudera Distribution 7.x, Cloud migration, RDBMS is must. Strong project experience with Amazon EMR/Databricks/Cloudera CDP is must. 4-5 experience building data pipelines using Hadoop components Sqoop, Hive, S
Easy Apply
Posted 22 days ago | Updated 2 days ago

Senior DBT/Snowflake Engineer

HR Pundits

•

Remote

Contract, Third Party

Senior DBT/Snowflake Engineer Experience: 8+ years We are looking for a skilled and experienced DBT-Snowflake Engineer Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases. Required Experience: Profi
Easy Apply
Posted 1 day ago | Updated 16 hours ago

Full Stack Software Engineer

iQuest Solutions Corp

•

Remote or New York, New York, USA

Contract

Job title: Full Stack Software Engineer US Location of work: Preference to be in the NY/NJ area but can be virtual Start Date: ASAP The Opportunity: We are seeking a strong Full Stack Software Engineer for our Cloud Service Business Networks Technical Solutions Client. The team provides subject matter expertise to deliver business solutions for financial institutions. You are great at: Time management, organizing and prioritizing tasks Communicating with a virtual globally located team Implem
Easy Apply
Posted 60+ days ago | Updated 21 days ago

AWS Data Engineer

OnwardPath Technology Solutions LLC

•

Remote

Contract

Job role: AWS Data Engineer Experience: 5-8 Years Start - ASAP Duration 12 months Remote role consultant can live anywhere in the US About the Role: We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will have 5+ years of experience in data engineering with a strong focus on AWS technologies. This role involves designing, developing, and maintaining scalable data pipelines and processing systems. The candidate should be adept at managing and optimizing
Easy Apply
Posted 15 hours ago

AWS Data Engineer

OnwardPath Technology Solutions LLC

•

Remote

Contract

AWS Data Engineer Start - ASAP Duration 12 months Remote role consultant can live anywhere in the US Citizenship does NOT matter but communication does matter and must be excellent. About the Role: We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will have 5+ years of experience in data engineering with a strong focus on AWS technologies. This role involves designing, developing, and maintaining scalable data pipelines and processing systems. The cand
Easy Apply
Posted 22 hours ago | Updated 20 hours ago

AI Solution Architect

LTIMindtree

•

Remote

Full-time

About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 9
Easy Apply
Posted 17 days ago | Updated 8 days ago

Machine Learning Engineer - Remote

BayOne Solutions

•

Remote

Contract

Job Title: Machine Learning Engineer Location: 100% RemoteDuration: 12+ Months Contract Client: Direct Client W2 Contract Skills: Design, develop, debug, and modify components of machine learning and deep learning systems and applications, including data/ETL and feature engineering pipelines.Work collaboratively with data scientists, machine learning engineers, program and product managers in the development of assigned components.Prototype creative solutions quickly by developing minimum viabl
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Senior Data Engineer

CodeMax Consulting, LLC

•

Remote or Arkansas, USA

Full-time, Contract, Third Party

Responsibilities: Design, construct, install, test, and maintain highly scalable data management systems on Azure and AWS, utilizing services such as Azure Data Lake, Azure Data Factory, AWS S3, and AWS Glue. Integrate new data management technologies and software engineering tools into existing structures, focusing on Azure and AWS ecosystems. Utilize Azure Databricks and AWS EMR for big data processing tasks to create data set processes for data modeling, mining, and production. Develop analy
Easy Apply
Posted 57 days ago | Updated 2 hours ago

Looking for Principal Machine Learning Engineer - Fulltime - Remote US

Epikso

•

Remote

Full-time

responsible for developing core solutions in data mining, machine learning, anomaly detection and natural language processing, positively impacting multiple existing client's flagship products and new offerings from the company. We are spearheading a fundamental shift in how businesses think about managing their wired and wireless networks by building high-performance, real-time multi-agent systems that can perceive, learn, and act intelligently on behalf of humans. As a part of this group, you
Easy Apply
Posted 8 days ago | Updated 8 hours ago

Google Cloud Platform Data Engineer

Saama Technologies, LLC

•

Remote

Contract, Third Party

Bachelors or Master s degree in computer science or related discipline.10+ years of relevant experience in software development, preferably in Data, Analytics, Information Management platformsExperience leading data integration efforts of internal and external data sourcesHands on experience in Data Analysis, Data Profiling and Data QualityStrong hands-on working knowledge of complex ELT, ETL, Cloud Computing and programming languagesHands-on working experience in Cloud platform (GPC). Preferabl
Easy Apply
Posted 1 day ago

Cloud Data Engineer

Saama Technologies, LLC

•

Remote

Third Party, Contract

Bachelors or Master s degree in computer science or related discipline.10+ years of relevant experience in software development, preferably in Data, Analytics, Information Management platformsExperience leading data integration efforts of internal and external data sourcesHands on experience in Data Analysis, Data Profiling and Data QualityStrong hands-on working knowledge of complex ELT, ETL, Cloud Computing and programming languagesHands-on working experience in Cloud platform (GPC, Azure, AWS
Easy Apply
Posted 2 days ago

Presales Engineer

Impetus

•

Remote

Full-time

Responsibilities: Develop use case demonstrations and proofs of concept in collaboration with sales, customers, and Impetus implementation teams.Work with and support the solutions architect to define and present Big Data and Cloud implementation architectures and project blueprints for customers and partners.Support in the technical responses to RFI/RFP.Explore new technology platforms and features to support customer/partner requirements.Maintain the highest level of technical and market knowl
Easy Apply
Posted 60+ days ago | Updated 1 day ago

Snaplogic Data Engineer

Exl Service

•

Remote

Full-time

We're looking to add Data Engineers in the coming months with 3-8 years of professional experience and proficiency in Python, SQL, ETL development, as well as on the AWS platform. By driving requirements gathering/analysis, development, testing, documentation, and deployment tasks, this technical and business-facing role works independently as well as collaboratively to ensure project success. The Data Engineer consultants have extensive experience developing solutions using modern data tools an
Easy Apply
Posted 60+ days ago | Updated 15 days ago

Databricks Data Engineer

Exl Service

•

Remote

Full-time

Job Description The Data Engineer Senior Consultant plays a critical role in the implementation of Enterprise Data Management (EDM) Solutions for Datasource Consulting/EXL Clients. They are responsible for setting the development standards and best practices, and may be required to assist with requirements gathering/analysis, development, testing, documentation, and deployment tasks. This is a business-facing role in which the consultant will work independently and collaboratively with internal
Easy Apply
Posted 60+ days ago | Updated 6 days ago