hadoop pyspark data pipeline build engineer Jobs

Refine Results
601 - 620 of 713 Jobs

Looking for AWS Redshift Data Engineer/Cloud Engineer :: 100% Remote- Must be in Wisconsin

Information Resource Group, Inc.

•

Remote or Madison, Wisconsin, USA

Third Party, Contract

Below are the job details for your reference: Title: AWS Redshift Data Engineer/Cloud Engineer Location: 100% Remote-Must be in Wisconsin Duration: 6 Months from projected start date Hrs./Wk.: 40 Interview Process: Remote, Microsoft Teams Note: Candidates must be current Wisconsin residents or willing to relocate at the candidates expense. This is 100% remote (within Wisconsin) Key Responsibilities: Collaborate with data engineering, business analysts, and development teams to design, develo
Easy Apply
Posted 2 days ago | Updated 18 hours ago

Palantir Developers

Enterprise Solution Partners LLC

•

Remote

Contract

Palantir developers - Remote Data engineers, python, pyspark, palantir foundry is must scala, hadoop, bigdata with only w2 candidates with EAD Excellent verbal and written communication skills, Strong knowledge in programming languages and coding principles and procedures
Easy Apply
Posted 11 days ago

Data Engineer

MetaSense, Inc.

•

Wilmington, Delaware, USA

Contract

Only W2 Must Have Skills : Python, PySpark, AWS, Databricks around 5 years in total 2-3 years in Python, PySpark, AWS, Databricks Job Description 5+ years of professional work experience designing and implementing data pipelines in a cloud environment is required. 2+ years of experience migrating/developing data solutions in the AWS cloud is required. 1+ years of experience building/implementing data pipelines using Databricks or similar cloud database. Expert level knowledge of using SQL to w
Easy Apply
Posted 2 days ago

Data Engineer

Chuwa America Corporation

•

Austin, Texas, USA

Third Party, Contract

Role: Data EngineerLocation: Austin, TX & Sunnyvale, CA Job Description:In the role of Lead Data Engineer, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all
Easy Apply
Posted 18 days ago

Data Visualization Specialist

AVA Consulting

•

Portland, Oregon, USA

Contract

AVA Consulting is seeking a Data Visualization Specialist Location: Portland, OR (Hybrid) U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time. Job Description: This is an opportunity to help build a world class, global research system that will drive Client s product roadmap. Seek, Client s in-house user feedback, bug reporting, and UX research system is being rebuilt for scale and simplicity, while incorporating new reporting and
Easy Apply
Posted 11 days ago | Updated 2 days ago

Data Engineer

V2Soft

•

Dearborn, Michigan, USA

Contract

V2Soft () is a global company, headquartered out of Bloomfield Hills, Michigan, with locations in Mexico, Italy, India, China and Germany. At V2Soft, our mission is to provide high performance technology solutions to solve real business problems. We become our customer s true partner, enabling both parties to enjoy success. We are committed to promoting diversity in the workplace, and believe it has a positive effect on our company and the customers we serve. Skills Required: Experience with Go
Easy Apply
Posted 6 days ago | Updated 10 hours ago

Azure Data Engineer

P2PSoftTek Inc

•

Remote

Contract

Azure Data Engineer Location- Remote Job Type-Long Term Description Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms. 10 + years of proven experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST. Solid knowledge of data warehouse best practices, development standards and me
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Google Cloud Platform Data Engineer (With Google Cloud Platform Certified)

EITAcies, Inc.

•

Remote or Dallas, Texas, USA

Full-time, Part-time, Third Party, Contract

About US : Since 2008, EITACIES has been a beacon of innovation, crafting tailored tech solutions. From humble beginnings, we've grown globally, nurturing client relationships and adapting to digital shifts. Today, we're a tech powerhouse, delivering customized excellence from startups to Fortune 500, State & Federal clients. Technical Skills: Google Cloud Platform Services: DataFlow, BigQuery, Cloud Storage, DataProc, Airflow, Composer, Pub/Sub and Memorystore/Redis Programming languages: J
Easy Apply
Posted 18 days ago | Updated 9 hours ago

Scala Developer

Capgemini America, Inc.

•

Québec City, Quebec, Canada

Full-time

Job Title: Scala Spark Developer Job location: Montreal, NY (Hybrid) Job description: The resource should have strong experience in Scala, Spark, Hive and Hadoop who could join in our team of IT professionals. Unix and Shell Scripting.Exposure to Git and Jenkins CI/CD pipeline.Responsibilities: Design, Analyze and organize raw data.Build data systems and pipelines.Conduct complex data analysis and report on results.Combine raw information from different sources.Explore ways to enhance data qual
Posted 48 days ago | Updated 21 hours ago

Big data engnieer

iMinds Technology Systems, Inc.

•

Phoenix, Arizona, USA

Contract

Role: Big Data Engineer (Java or Python) Location: Phoenix, AZ (Day 1 On-site 3 days a week) (Locals only) Job Description: Required Skills: 6+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience working with Map-Reduce, Hive, Spark (core, SQL, and PySpark) Solid Data warehousing concepts, and Knowledge of the Financial reporting ecosystem will be a plus Expert in Distributed ecosystem Hands-on experience with programming using
Easy Apply
Posted 11 days ago

AI/ ML Engineer

Resource 1

•

Remote

Contract

Resource 1 is in need of an Artificial Intelligence (AI)/ Machine Learning (ML) Engineer for a long-term, remote contract position. Responsibilities: Architect, build, maintain and improve new and existing suite of algorithms and their underlying systemsImplement end-to-end solutions for batch and real-time algorithms along with requisite tooling around monitoring, logging, automated testing, performance testing and A/B testingEstablish scalable and efficient automated processes for data analyse
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Data Engineer

Lorvin Technologies

•

Tampa, Florida, USA

Contract

Need only local candidates Need: 12 + Job Description: Proven experience as a data architect or similar role designing and implementing complex data solutions.Strong proficiency in Python programming and experience with PySpark for big data processing.Experience with AWS services including Glue, EMR, Lambda, S3, and Spark.Knowledge in dynamo, Redis, aurora, data lakesExperience in Flink is added advantage.Knowledge of data warehousing concepts, dimensional modeling, and ETL processes.Familiarit
Easy Apply
Posted 4 days ago

Senior Data Engineer

Kforce Technology Staffing

•

Mooresville, North Carolina, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a Senior Data Engineer in Mooresville, NC. Responsibilities: * Translates complex cross-functional business requirements and functional specifications into logical program designs, code modules, stable application systems, and data solutions; Partners with Product Team to understand business needs and functional specifications * Coordinates, executes, and participates in component integration (CIT) scenarios, systems integration testing (SIT
Posted 4 days ago | Updated 1 day ago

Data Analyst

Net2Source Inc.

•

Bethlehem, Pennsylvania, USA

Contract

Net2Source Inc. is an award-winning total workforce solutions company recognized by Staffing Industry Analysts for our accelerated growth of 300% in the last 3 years with over 5500+ employees globally, with over 30+ locations in the US and global operations in 32 countries. We believe in providing staffing solutions to address the current talent gap - Right Talent - Right Time - Right Place - Right Price and acting as a Career Coach to our consultants.Data Analyst Onsite : 6255 Sterners Way, Bet
Easy Apply
Posted 2 days ago | Updated 10 hours ago

Data Architect/ Data Engineer

Object Technology Solutions, Inc.

•

Irving, Texas, USA

Contract

Object Technology Solutions, Inc (OTSI) has an immediate opening for a Data Architect/ Data Engineer. Data Architect/ Data Engineer (Irving, TX) MAJOR RESPONSIBILITES: The ideal candidate will have experience in customer-facing roles and success leading deep technical architecture discussions with senior customer executives, Enterprise Architects, IT Management and Developers to drive Data Platform and Advanced Analytics solutions to productions.Understand customers overall data estate, IT and b
Easy Apply
Posted 38 days ago | Updated 16 days ago

AI Engineer, Specialist, Analyst

Hirekeyz

•

Owings Mills, Maryland, USA

Contract

Title: AI Engineer, Specialist, Analyst Location: Owings Mils, MD can be Remote Duration: Long Term contract Summary: We are seeking a talented and experienced Artificial Intelligence Engineer to join our team.The ideal candidate will have a strong background in computer science, machine learning, and deep learning techniques.As an AI Engineer, you will be responsible for developing, implementing, and optimizing AI algorithms and models to solve complex problems and enhance business processes.R
Easy Apply
Posted 11 days ago | Updated 2 days ago

Azure or Python Data Engineer

Phaxis, LLC

•

Newark, New Jersey, USA

Contract

5+ years of experience in building data and analytics platform focused on Azure data and analytics solutions 5+ years of programming experience in Python/Pyspark Good experience in Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Knowledge of data modeling and data warehousing concepts Experience with cloud-based data migration o ETL tools (e.g., SSIS, Azure Data Factory, Power BI Dataflow) o Database management (MSSQL, Azure SQL Databas
Easy Apply
Posted 9 days ago | Updated 3 days ago

Azure Databricks Developer

Skill Inventions Inc

•

Dallas, Texas, USA

Contract

Title: Azure DataBricks Engineer Functional Skills: Azure Databricks, Python, Spark Location: Dallas, TX / Chicogo, IL Exp Required: Overall 8+ years of experience as developer in Big data technologies like Databricks/Spark and Hadoop ecosystems Experience in developing Spark applications using spark-SQL in Databricks for data extraction, transformation and aggregation from muitiple file formats for analyzing and transforming the data to uncover insights into the customer usage patterns Extract,
Easy Apply
Posted 11 days ago | Updated 3 days ago

Sr Data Scientist (Gen AI, LLM)

CloudBCLabs

•

Remote

Full-time, Third Party

Job Description Education: MS in Computer Science, Statistics, Math, Engineering, or related field, PhD preferred 3+ years of relevant experience in building large scale machine learning or deep learning models and/or systems 1+ year of experience specifically with deep learning (e.g., CNN, RNN, LSTM) 1+ year of experience building NLP, LLM and GenAI tools. Experience with LoRA, LangChain, RAG, LLM Fine Tuning and PEFT are preferred. Demonstrated skills with Jupyter Notebook, AWS Sagemaker, o
Easy Apply
Posted 17 days ago

Principal Machine Learning Engineer-Generative AI Applications

Excellerent Technology Solutions

•

Remote

Third Party, Contract

Urgently Looking for Sr. Machine Learning Engineer, Generative AI Applications Required Skills and Qualifications: Minimum of seven years post-secondary education or relevant work experienceBachelor's degree in mathematics, physics, computer science, engineering, statistics, or an equivalent technical discipline.Minimum of five years software development experience with Python and SQL.Minimum of three years experience building pipelines to deploy NLP and deep learning models into production in a
Easy Apply
Posted 60+ days ago | Updated 2 days ago