hadoop pyspark data pipeline build engineer Jobs in portland, or

Refine Results
1 - 20 of 99 Jobs

Remote::Python pyspark Data Engineer

Ivy Tech Solutions Inc

•

Remote

Contract

HI, Kindly let me know if you have a suitable fit for the following position Thanks Remote Data Engineer with Strong Python pyspark Duration: 12+Months Only w2 or 1099 Please send the resume to or Recognized as an expert with specialized depth and breadth of expertise in their discipline. Solves complex problems, taking a broad perspective to identify solutions. Requires advanced proficiency in Python and SQL programming, as well as several years of hands-on experience creating automated data
Easy Apply
Posted 5 days ago | Updated 3 days ago

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

•

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Sr. AZURE Data Engineer/Architect-PYTHON & PYSPARK

Long Finch Technologies

•

Remote

Contract, Third Party

Hands on Interview on SQL, Python, Pyspark. Must have Skills : Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms.12 + years of proven IT exp.experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST.Solid knowledge of data warehouse best practices, development standards and me
Easy Apply
Posted 60+ days ago | Updated 3 days ago

AWS Data Engineer - 14+ years consultants ONLY

Virtue Group

•

Remote

Contract

AWS Data Engineer *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. Looking for data engineer who has below exp.>Minimum 14+ years candidate.AWS GluePyspark expertAwsStreaming exp is MUSTAmazon Kinesis Data Streams, Apache Kafka, and Amazon Managed Streaming for Apache Kafka (Amazon MSK).
Easy Apply
Posted 9 days ago | Updated 2 days ago

AWS Data Engineer

Big Apple Infotech

•

Remote

Contract

Hello Professionals, Greetings From Big Apple Infotech! Title: AWS Data EngineerLocation : East Coast or Central (Remote)Need 12+ Years of experienceDuration: Long Term Contract JD: AWS Data Engineer (Spark, AWS, Glue) Must Skill:Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilitiesDesign and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large disparate datasetsBuild
Easy Apply
Posted 2 days ago

AWS Data Engineer

Yash Technologies

•

Remote or Harrisburg, Pennsylvania, USA

Full-time

Experience Designing, developing, and maintaining scalable, secure, and cost-effective data solutions on the AWS platformHands on experience with the following AWS services:Event BridgeStep FunctionsGlue, Glue data CatalogAthenaRedshiftLambdaDynamoDBSecrets ManagerS3Strong knowledge of SQL & PySparkHands on experience of IAM, Roles & PoliciesHands on experience in creating CDK.Knowledge of Jenkins for deployment automation Knowledge of Quicksight is a plus Non-Technical: Strong communication sk
Easy Apply
Posted 31 days ago

Azure Data Engineer

Golden Resources. Inc.

•

Remote

Contract

Position Summary Accountable for developing and delivering technological responses to targeted business outcomes. Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration , where needed. Demonstrate the company's core values of respect,
Easy Apply
Posted 60+ days ago | Updated 18 days ago

AWS Data Engineer

NTT DATA Americas, Inc

•

Remote or Raleigh, North Carolina, USA

Contract

At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees have been key factors in our company s growth and market presence. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. For more than 25 years, NTT DATA Services have focused on impacting the core of your business operations with industry-leading outsourcing s
Easy Apply
Posted 60+ days ago | Updated 3 hours ago

Software Engineer In Test

Agile

•

Remote

Full-time

Title: SDET Compensation: $160k - $190k Benefits: Medical, Dental, Vision, 401k, Disability, and more Location: 100% Remote Our client does amazing work leading innovation in the medical industry, and they're looking for an SDET to lead that innovation. This is a salary role, and it's 100% remote. The ideal candidate will have: 4+ years of software engineering experience, using software testing tools, ML frameworks, containerization, CI/CD, and AWS.Experience automating component and integration
Easy Apply
Posted 20 days ago

MLOPS Engineer

SRI Tech Solutions

•

Portland, Oregon, USA

Contract, Third Party

Job Description: Need minimum 15 years of overall experience. Refactoring, tuning, optimizing, containerization, and productionalizing ML solutions in recommendations domain platform solutions (such as AWS Sagemaker) Enable ML models testing, validation and automate testing framework Collaborate across functional teams (including Consumer Data Sciences, MLOps Core, Platform teams) to deliver ML models in production and enable end to end testing PySpark, Databricks, Python, Sagemaker, MLOps Leade
Easy Apply
Posted 5 days ago | Updated 2 days ago

Senior AI/ML Engineer (Onsite Role)

SRI Tech Solutions

•

Portland, Oregon, USA

Contract, Third Party

obDescription: Refactoring, tuning, optimizing, containerization, and productional zing client ML solutions in recommendations domain to clint platform solutions (such as AWS Sagemaker) Enable ML models testing, validation and automate testing framework.Collaborate across functional teams (including Consumer Data Sciences, MLOps Core, Platform teams) to deliver ML models in production and enable end to end testingPySpark, Databricks, Python,Sagemaker, MLOpsLeadership capability to handle multipl
Easy Apply
Posted 20 days ago | Updated 2 days ago

Machine Learning Engineer

Diamond Pick

•

Remote

Contract

Software Engineer - ML Remote Contract to Hire Our group is responsible for developing core solutions in data mining, machine learning, anomaly detection and natural language processing, positively impacting multiple existing Extreme flagship products and new offerings from the company. We are spearheading a fundamental shift in how businesses think about managing their wired and wireless networks by building high-performance, real-time multi-agent systems that can perceive, learn, and act in
Easy Apply
Posted 4 days ago

Data Engineer (Data Catalog, Metadata Management)

Interon IT Solutions LLC

•

Remote

Contract

We have an immediate opening for Data Engineer (Data Catalog, Metadata Management). Please go through the requirement and reply with your updated profile, contact details, and your availability if you would be interested in it. Role: Data Engineer (Data Catalog, Metadata Management)Location: RemoteHiring Type: Contract SkillsAzure Data Factory; Databricks; PYSPARK; SQL; Web Service Restful API Data Engineer (Data Catalog, Metadata Management)This position is to develop, manage, integrate and ma
Easy Apply
Posted 4 days ago

AWS Data Engineer

Allwyn Corporation

•

Remote

Third Party, Contract

Job Title: AWS Data Engineer Location: Washington D.C (Remote) AWS Hands On development, Extensive experience in cloud technologies for streaming platforms, with a focus on AWS services for data lake creation, orchestration, and analytics.Innovative problem solver with a demonstrated ability to develop intricate algorithms based on deep-dive statistical analysis, enhancing customer relationships, and personalizing interactions.Hands-on experience with cloud-based tools such as AWS EMR, EC2, Data
Easy Apply
Posted 3 days ago

Azure Data Engineer

Techmatic Inc

•

Remote

Contract, Third Party

Job Details: We need an Azure Data engineer that has very strong Azure Data Bricks experience along with the typical Azure data stack tools like Data Factory, Synapse, etc. as well as SQL and tools like PySpark. Any experience with Fabric is a huge plus as the team will be utilizing Fabric on this project. Job Description: We are seeking a talented and experienced Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a pivotal role in designing, implementing, an
Easy Apply
Posted 2 days ago

Senior Data Engineer (W2 Remote)

Performix Business Services, LLC

•

Remote or Chicago, Illinois, USA

Contract

This is primarily an ETL data engineer position. For tools they will need to have Databricks and PySpark (for distributed ETL). They need to know python as that is the language used to deploy Databricks tasks.They will need to write pipelinesPerformance enhancement and awarenessMid-level person with 4-5 years of experienceLooking for a data engineer with Python and Databricks skill set. The job primarily involves writing and maintaining data pipelines for various Ag related datasets.It is a rem
Easy Apply
Posted 11 days ago

Azure Architect/ Azure Data Architect

Brilliant Infotech Inc.

•

Remote

Full-time

Role: Azure Architect/ Azure Data Architect Location: Remote Duration: Long term contract Note: We are unable to sponsor visa at this time. Job Summary: We are seeking a strong experienced Azure Data Solutions Architect. If you are data freak and looking for a professionally challenging and rewarding career this position might be of interest to you into the world of data. Azure Data Solutions Architect will spearhead new Data Driven initiatives IT Projects and Consulting services using Azure D
Easy Apply
Posted 53 days ago | Updated 3 days ago

Senior Cloud Engineer

InfoCepts LLC

•

Remote

Full-time

Position:Senior Cloud Data Engineer Purpose of the Position:As a Senior Cloud Data Engineer, this position requires candidate who are enthusiastic about data and driven to help in organization's AI & Analytics challenges. As a member of the team, you will help our clients on their data and analytics journey, by building data pipelines, improving consistency, and building the necessary infrastructure to support their analytics platform. Location: Remote - Any state in USA Type of Employment: Full
Easy Apply
Posted 4 days ago

Sr. Lead Data Scientist

TEK FYNDER

•

Remote or Arkansas, USA

Third Party, Contract

Job: Sr. Lead Data Scientist Duration: 12 months contract Location: 100% Remote Top Skills: Airline Revenue Management experience is a must 4 to 6 yrs as Lea Google Cloud (Google Cloud Platform) that is the preference but other cloud experience will work. Programming- Python and C++ Data: PySpark Experience with Rally and JIRA is good. Job Description: SABRE CORPORATION is a leading technology provider to the global travel and tourism industry. Headquartered in Southlake, Texas, USA. we serve
Easy Apply
Posted 13 days ago | Updated 1 day ago

IT Engineer (Data Engineer)

HawkB Inc

•

Remote

Full-time

Job Description: Job Title: IT Engineer (Data Engineer). Job Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark SPARK Performance\tuning\optimization Identify and optimize long running Databricks SPARK jobs. Monitor resource utilization and costs associated with Databricks usage, identifying opportunities for optimization and cost reduction. Analyze cluster performance metrics and implement tu
Easy Apply
Posted 5 days ago