Hadoop PySpark Data Pipeline Build Engineer Jobs

Refine Results
1 - 20 of 726 Jobs

Data Engineer(Python/Pyspark, Azure)

VLink Inc

•

Mississauga, Ontario, Canada

Full-time, Third Party

HI This is Mukul from V link . We have an urgent Requirement of Data Engineer(Python/Pyspark, Azure) in Mississauga, ON Role: Data Engineer(Python/Pyspark, Azure) Location: Mississauga, ON (hybrid) Overview: Looking for an Integration engineer responsible for daily support and project based development of credit risk management systems. ETL developers are responsible for designing and creating the data warehouse and all related extraction, transformation and load of data functions. This is an
Easy Apply
Posted 4 days ago

Lead Software Engineer (Pyspark/Data/Snowflake/AWS Lead)

JPMorgan Chase & Co.

•

Wilmington, Delaware, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Home Lending and Auto Technology , you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technica
Posted 22 days ago | Updated 10 hours ago

Software Engineer III - Java, React, BI Tools and Data Pipeline

JPMorgan Chase & Co.

•

Jersey City, New Jersey, USA

Full-time

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer at JPMorgan Chase within the Corporate Technology Engineering and Architecture team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business fu
Posted 9 days ago | Updated 10 hours ago

Sr. Cloud Data Pipeline Engineer

Walkwater Technologies

•

Santa Clara, California, USA

Contract

ROLE Sr. Cloud Data Pipeline Engineer LOCATION Santa Clara, CA RATE - We can pay on C2C or 1099 MAIN SKILLS Google Cloud Platform Data Engineer Certification required, Need someone who has worked on google transfer service from amazon s3 bucket to google cloud storage buckets, Kubernetes, Big Query, JAVA, J2EE, Spring Frameworks, Spring Boot, Kafka, Google Pub/Sub, , google cloud storage, google transfer service Job Details: We need someone with experience on google cloud technologies like Kuber
Easy Apply
Posted 8 days ago

Senior Data Engineer with Airflow; Python & PySpark (12+ years Exp.)

Global It Solutions Usi Inc

•

Remote

Full-time, Third Party

Position: Senior Data Engineer withAirflow; Python & PySpark Client Location: Los Angeles, CA or NYC, NY/NJ (Remote) Job Type: Full Time Employment with Prime Implementer (not with End-client) Salary: $$ per Annum + Benefits package Candidates that are Authorized to Work for Any Employer in United States without Sponsorship are encouraged to apply. Key Skills: Data EngineeringPythonPySparkAWSApache AirflowMust have Skills: Must have at least 12+ years strong Data Engineering with Cloud experienc
Easy Apply
Posted 27 days ago | Updated 5 days ago

Looking for Data Engineer(Spark+ Pyspark and Databrick).

Xoriant Corporation

•

Boston, Massachusetts, USA

Contract

Looking for Data Engineer(Spark+ Pyspark and Databrick). Location - Boston, MA or Princeton, NJ(Hybrid role) Long term contract Education and experience Qualification Bachelors degree in Computer Science, Information Systems, or equivalent education or work experienceAround 5+ years of experience as a developer on cloud technologiesAny AWS and/or Databricks certification will be a plusSkill Sets Required Good decision-making and problem solving skillsSolid understanding of Databricks fundamenta
Easy Apply
Posted 60+ days ago | Updated 5 days ago

W2 Only - Data Engineer (Python, React, Hadoop & Cloud)

New Millennium Consulting

•

Plano, Texas, USA

Contract

One of our Fortune 100 clients in Plano, TX is looking for a Full Stack Data Engineer/Developer. Title: Full Stack Data Engineer / Developer Location: Plano, TX (Fri Remote) Hourly: $70 per hour (W2) Duration: 1 year (Contract-to-Hire) Stack Experience: Minimum 5 years of Full Stack expertise in one of the following stacks and comfortable exploring others MERN stack: JavaScript - MongoDB - Express - ReactJS - Node.js (Preferred)MEAN stack: JavaScript - MongoDB - Express - AngularJS - Node.jsLAMP
Easy Apply
Posted 55 days ago | Updated 1 day ago

Data Engineer with Python, Pyspark, Bigdata & Google Cloud Platform Technologies (Cloud Run, DataProc, BigQuery (Only W2 role & strictly no C2C Accepted) 3.13.24

Systems Technology Group Inc. (STG)

•

Dearborn, Michigan, USA

Full-time

Title: Data Engineer with Python, Bigdata & Google Cloud Platform Technologies (Cloud Run, DataProc, BigQuery (Only W2 role & strictly no C2C Accepted) 3.13.24 Description: STG is a SEI CMMi Level 5 company with several Fortune 500 and State Government clients. STG has an opening for Google Cloud Platform Data Engineer with Python, Bigdata & Google Cloud Platform Technologies (Cloud Run, DataProc, BigQuery. Please note that this project assignment is with our own direct clients. We do not go th
Easy Apply
Posted 42 days ago | Updated 27 days ago

Data Engineer - ETL, Databricks, PySpark, SQL

Travelers

•

Hartford, Connecticut, USA

Full-time

Who Are We? Taking care of our customers, our communities and each other. That's the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 160 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what you do and where you do it. Compensation Overview The annual base salary range provided for this position is a nationwide market range and re
Posted 60+ days ago | Updated 11 hours ago

Pyspark Data Engineer / Pyspark Developer

KPI Partners, Inc.

•

Remote

Contract

8-10 Years of total experience collaborating with cross-functional teams, including machine learning engineers, software developers, analytics engineers, and product managers to translate business requirements into highly available data solutions3+ years of experience developing and implementing data pipelines using PySpark.Proven experience with SQLGood to have Databricks CertificationGood to have knowledge in DevOps and CI/CD deployments, Cloud migration methodologies and processes.
Easy Apply
Posted 60+ days ago | Updated 16 hours ago

Senior Data Engineer (AWS, PySpark, Redshift, Datalake) ** Direct end client **

Projas Technologies, LLC

•

Remote

Contract, Third Party

We are seeking aSenior Data Engineerwith a strong background insoftware development,AWS cloud services, PySpark, S3 based datalake, EMR, Hive, SparkSQL. The successful candidate will collaborate with our team of AI scientists and data analysts to design, develop, and maintain data pipelines and systems that support clinical and operational data use-cases. Key Responsibilities: Design, develop, and maintain scalable data pipelines and systems to support clinical and operational data use-cases.Uti
Easy Apply
Posted 60+ days ago | Updated 30 days ago

Data Analyst/Engineer Techno Functional Analyst (Jersey City) x2

Matlen Silver

•

Jersey City, New Jersey, USA

Full-time

Job Title: Data Analyst/Engineer Techno Functional Analyst Duration: 12-18 months Location: Jersey City, NJ or Charlotte, NC Required Pay Scale: 60-65/Hour on W2 Job Summary: Project Details: Corporate treasury data horizontal team is migrating off of Oracle RDBMS to a Hadoop Infrastructure. Processing 4 billion records of treasury data per day. POCs are complete, they are now processing data in about 1 hour. They need to hire this "techno functional analyst" not to face off with business, but
Easy Apply
Posted 7 days ago | Updated 2 hours ago

Data Ops Engineer

Intraedge

•

Phoenix, Arizona, USA

Contract

Job Title: : Data Ops Engineer Location: Phoenix, AZ Duration: Long Term Contract Qualifications: 1. 5+ years of overall software engineering experience that includes hands-on software development, data engineering 2. 3+ years for hands-on coding experience in SQL, Python, PySpark 3. 3+ years of experience with advanced orchestration tools like Apache Airflow 4. 2+ years of experience in at least one cloud (Azure, AWS, Google Cloud Platform) platforms, preferably Google Cloud Platform 5. Experi
Easy Apply
Posted 6 days ago | Updated 18 hours ago

Sr. AZURE Data Engineer-PYTHON & PYSPARK

Long Finch Technologies

•

Remote

Contract, Third Party

Hands on Interview on SQL, Python, Pyspark. Must have Skills : Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms.10 + years of proven experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST.Solid knowledge of data warehouse best practices, development standards and methodolo
Easy Apply
Posted 60+ days ago | Updated 1 day ago

AWS Data Engineer

Yash Technologies

•

Remote or Harrisburg, Pennsylvania, USA

Full-time

Experience Designing, developing, and maintaining scalable, secure, and cost-effective data solutions on the AWS platformHands on experience with the following AWS services:Event BridgeStep FunctionsGlue, Glue data CatalogAthenaRedshiftLambdaDynamoDBSecrets ManagerS3Strong knowledge of SQL & PySparkHands on experience of IAM, Roles & PoliciesHands on experience in creating CDK.Knowledge of Jenkins for deployment automation Knowledge of Quicksight is a plus Non-Technical: Strong communication sk
Easy Apply
Posted 6 days ago

Data Analyst/Engineer Techno Functional Analyst (Jersey City) x2

Matlen Silver

•

Jersey City, New Jersey, USA

Full-time

Job Title: Data Analyst/Engineer Techno Functional Analyst Duration: 12-18 months Location: Jersey City, NJ or Charlotte, NC Required Pay Scale: 60-65/Hour on W2 Job Summary: Project Details: Corporate treasury data horizontal team is migrating off of Oracle RDBMS to a Hadoop Infrastructure. Processing 4 billion records of treasury data per day. POCs are complete, they are now processing data in about 1 hour. They need to hire this "techno functional analyst" not to face off with business, but
Easy Apply
Posted 36 days ago | Updated 2 hours ago

Azure Data Engineer

Golden Resources. Inc.

•

Remote

Contract

Position Summary Accountable for developing and delivering technological responses to targeted business outcomes. Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration , where needed. Demonstrate the company's core values of respect,
Easy Apply
Posted 60+ days ago | Updated 22 days ago

Lead Data Engineer

Sriven Systems Inc.

•

Seattle, Washington, USA

Contract

Lead Data Engineer Location: Seattle, Washington Duration: Long Term Top Skills' Details o 5-7+ years Architect and design large scale high performance distributed systems o 5-7+ years SQL Platform o 2+ years Exposure No-SQL Platform is a plus o 5+ years Hadoop, YARN, MapReduce, Pig or Hive, Spark o 2+ years Data platform implementation on Azure or AWS is a plus Nice-to-Haves: Knowledge of data security best practices and the implementation of measures to ensure data privacy and compliance. Imp
Easy Apply
Posted 14 days ago

Sr. Data Engineer

Ford Motor Company

•

Pennsylvania, USA

Full-time

Job Description GDIA Tech - Customer 360 Data Marts (CDM) team is looking for a Sr. Data Engineer with hands on experience using Lean and Agile methodologies to build and deliver various Purpose Built Data Products. Data Engineer will be part of the CDM portfolio and will collaborate with Product Managers, Designers and Product Owners to build, validate and release Data Products. Work with other foundational teams in defining the strategy, roadmap and Technical foundational capabilities on Goog
Posted 10 hours ago

Data Engineer

Apex Systems

•

Hoboken, New Jersey, USA

Full-time

Job#: 2023515 Job Description: Apex Systems combines with parent company ASGN Inc. to make it the 2nd largest IT staffing agency in the country. Apex has an opportunity for a Scala Engineer . If interested in discussing the position further, please send an MS Word version of your resume to Patryk Kopczynski, . To apply please email your resume to Here are the details: Position: Scala Engineer Location: Twice a week to one of these location Hoboken, NJ Sunnyvale, CA Herndon, VA Duration: 12
Easy Apply
Posted 20 days ago | Updated 2 hours ago