Hadoop PySpark Data Pipeline Build Engineer Jobs

Refine Results
21 - 40 of 610 Jobs

Data Architect - Manufacturing

Pozent

•

New York, New York, USA

Contract

12 month contract Remote 100 percentProject description Applying to the position, you may join one of the most respected and fastest growing institutional investors in the world. Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability. The company invests in all major asset classes, including public equity, private equity, real estate, infrastructure and fixed-income instruments. Client attracts and selects high-calibre i
Easy Apply
Posted 2 days ago | Updated 3 hours ago

Principal Data Engineer -53328

PRIMUS Global Services Inc.

•

Bellevue, Washington, USA

Contract, Third Party

Principal Data Engineer -53328 We have an immediate long-term opportunity with one of our largest clients for a position of Principal Data Engineer, to work in Bellevue WA Responsibilities: Utilize Azure services including ADF for orchestration, ADLS for storage, and AzureDevOps for CI/CD. Design, develop, and maintain ETL processes leveraging Databricks and Spark. Write and maintain PowerShell scripts for automation tasks. Utilize SQL (TSQL, PostgreSQL) for data manipulation and querying. Wor
Easy Apply
Posted 15 days ago | Updated 1 day ago

Sr. AZURE Data Engineer/Architect-PYTHON & PYSPARK

Long Finch Technologies

•

Remote

Third Party, Contract

Hands on Interview on SQL, Python, Pyspark. Must have Skills : Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms.12 + years of proven IT exp.experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST.Solid knowledge of data warehouse best practices, development standards and me
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Snowflake Data Engineer

Cygnus Professionals

•

Austin, Texas, USA

Contract

Data Engineer _ Snowflake Lead Austin, TX (Day one on site) / Sunnyvale, CA We need strong data folks with Snowflake, Python, SQL. Requirements: SnowflakeData ModelingPySparkPythonSQLDatawarehouseAWS good to haveGood communication skill Role and Qualification Snowflake Data Engineers are required to have the following qualifications:Minimum of 10+ year of experience designing and implementing a full-scale data warehouse solution based on Snowflake.A minimum of three years experience in develo
Easy Apply
Posted 4 days ago

AWS Data Engineer - 14+ years consultants ONLY

Virtue Group

•

Remote

Contract

AWS Data Engineer *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. *NOTE: Candidate must be strong on AWS coupled with 14 years of experience overall experience. Looking for data engineer who has below exp.>Minimum 14+ years candidate.AWS GluePyspark expertAwsStreaming exp is MUSTAmazon Kinesis Data Streams, Apache Kafka, and Amazon Managed Streaming for Apache Kafka (Amazon MSK).
Easy Apply
Posted 8 days ago | Updated 1 day ago

AWS Data Engineer

Big Apple Infotech

•

Remote

Contract

Hello Professionals, Greetings From Big Apple Infotech! Title: AWS Data EngineerLocation : East Coast or Central (Remote)Need 12+ Years of experienceDuration: Long Term Contract JD: AWS Data Engineer (Spark, AWS, Glue) Must Skill:Work with development teams and other project leaders/stakeholders to provide technical solutions that enable business capabilitiesDesign and develop data applications using big data technologies (AWS, Spark) to ingest, process, and analyze large disparate datasetsBuild
Easy Apply
Posted 1 day ago

Senior Data Engineer - Virginia | Fulltime Only - Onsite | Wissen Technology

Wissen Infotech

•

Richmond, Virginia, USA

Full-time

Data Engineer- FTE, Wissen Technology, Virginia - Hybrid The Wissen team continues to expand its footprint in the US. More openings to come as we continue to grow the team! Please read below for a brilliant career opportunity. Please do not apply if you do not fit the grid. Role: Data Engineer Title: Associate/AVP Location: Virginia(Day 1 Onsite/Hybrid) Fulltime Mode of Work: 3 days/week onsite required Your required skills: 8-10 Years Required Max Budget: $120k Skills: Bachelor's degree in Co
Easy Apply
Posted 3 days ago | Updated 1 day ago

Data Engineer

Softpath System, LLC.

•

Richmond, Virginia, USA

Contract

Job Details: Job Title : Data Engineer Location : Richmond, VA Duration : 12 Months Contract - with intent to extend contingent on project need/performance. Schedule: Hybrid In office every other week Job Description: Qualifications 1. Minimum 5 years working experience as Data Analyst 2. Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts 3. Minimum 5 years working experience in SQL, Stored Procedures and Table Design 4. Minimum 5 years working expe
Easy Apply
Posted 8 days ago

Java Developer with Data Engineer

Spiceorb

•

Sunnyvale, California, USA

Contract

Hi, Spiceorb is looking for Java Developer with Data Engineer to work for CONTRACT on Hybrid basis in Sunnyvale, CA If you are interested and a good fit for the position, then please email me an updated copy of your resume with best time number and time to contact you. Java Developer with Data Engineer Location: Sunnyvale, CA - HybridExp: 12+ JD Java developer with hive, spark Hadoop and Google Cloud Platform - all the skills are must.. Need a candidate with a combination of Java and data.
Easy Apply
Posted 16 days ago | Updated 1 day ago

Technical Program Manager - Data Engineering

GSPANN Technologies

•

Fremont, California, USA

Contract

About GSPANN We work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world s most respected brands. We ve worked with more than 200 organizations and have served as a trusted business partner for some of the world s most respected brands. Our solutions have the businesses create custom-designed technology platforms, which have transformed the way our clients connect with their employees, partners, and customers. GSPANN is headquartere
Easy Apply
Posted 8 days ago | Updated 3 days ago

AWS Data Engineer

Yash Technologies

•

Remote or Harrisburg, Pennsylvania, USA

Full-time

Experience Designing, developing, and maintaining scalable, secure, and cost-effective data solutions on the AWS platformHands on experience with the following AWS services:Event BridgeStep FunctionsGlue, Glue data CatalogAthenaRedshiftLambdaDynamoDBSecrets ManagerS3Strong knowledge of SQL & PySparkHands on experience of IAM, Roles & PoliciesHands on experience in creating CDK.Knowledge of Jenkins for deployment automation Knowledge of Quicksight is a plus Non-Technical: Strong communication sk
Easy Apply
Posted 30 days ago

Data Analyst/Engineer Techno Functional Analyst (Jersey City) x2

Matlen Silver

•

Jersey City, New Jersey, USA

Full-time

Job Title: Data Analyst/Engineer Techno Functional Analyst Duration: 12-18 months Location: Jersey City, NJ or Charlotte, NC Required Pay Scale: 60-65/Hour on W2 Job Summary: Project Details: Corporate treasury data horizontal team is migrating off of Oracle RDBMS to a Hadoop Infrastructure. Processing 4 billion records of treasury data per day. POCs are complete, they are now processing data in about 1 hour. They need to hire this "techno functional analyst" not to face off with business, but
Easy Apply
Posted 60+ days ago | Updated 18 hours ago

Data Scientist Level V / Machine Learning Engineer Level V

Calsoft Labs

•

San Jose, California, USA

Contract

We have W2 Contract Position as a Data Scientist Level V / Machine Learning Engineer Level Vrole with one of our direct client. Title: Data Scientist Level V / Machine Learning Engineer Level V Location: San Jose, CA/ Salt Lake City, UT / Austin, TX (Onsite) Job Description: Experience working on client Security data, which spans into Petabytes. They lack a Data Scientist / Machine Learning Engineer and seek someone to bridge this gap. The ideal candidate will assist the team in building ML m
Easy Apply
Posted 46 days ago | Updated 4 days ago

Data Engineer

Object Technology Solutions, Inc.

•

Irving, Texas, USA

Contract

OTSI (Object Technology Solutions, Inc) has an immediate opening for a Data Engineer Location Irving, TX (Hybrid) Job Description: Analyse and understand data sources & APIsDesign and Develop methods to connect & collect data from different data sourcesDesign and Develop methods to filter/cleanse the dataDesign and Develop SQL , Hive queries, APIs to extract data from the storeWork closely with data Scientists to ensure the source data is aggregated and cleansedWork with product managers to u
Easy Apply
Posted 4 days ago | Updated 3 days ago

Azure Data Engineer

Golden Resources. Inc.

•

Remote

Contract

Position Summary Accountable for developing and delivering technological responses to targeted business outcomes. Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration , where needed. Demonstrate the company's core values of respect,
Easy Apply
Posted 60+ days ago | Updated 17 days ago

Software Engineer/ W2 Only

DVI Technologies, Inc.

•

Pittsburgh, Pennsylvania, USA

Contract

Req No: 135512 Role: Software Engineer Duration: 6 months (C2H Under W2 payroll) Location: Pittsburgh PA Cleveland OH - Strongsville Technology Center Hybrid 3 days min in office/week Summary: Responsible for writing programs to maintain and control computer systems software for operating systems, networked systems, and database systems. Responsible for creating the software platform, and then fine-tuning the final program after it has been made. Job Responsibilities: Modify existing software t
Easy Apply
Posted 1 day ago | Updated 1 day ago

Pyspark Developer

CSM Technologies Inc

•

Plano, Texas, USA

Full-time

Job Title: Pyspark Developer Location : Plano, TX Job Description Hands-on Pyspark SME with multiple project experience with Data planforms comprising of Hadoop, Teradata Data Warehouse, Ab Initio, Informatica, Java Spark (DPL), SSIS, AWS Lake Formation (S3), SnowflakeAbility to design, build and unit test applications on Spark framework on Python.Build PySpark based applications for both batch and streaming requirements, which will require in-depth knowledge on majority of Hadoop and NoSQL data
Easy Apply
Posted 60+ days ago | Updated 4 days ago

Specialty Software Engineer Lead/ Hadoop Big Data Lead/ Only W2/ C2H

DVI Technologies, Inc.

•

Strongsville, Ohio, USA

Contract

Role: Specialty Software Engineer Lead Position Location: 1st Preference - Strongsville/Cleveland/Columbus OH 2nd Preference - Remaining Hubs Pittsburgh, PA Birmingham, Alabama Dallas, TX Phoenix, AZ Ability to work remote: Hybrid - 3 office / 2 remote Acceptable time zone(s): Central/Eastern DURATION: 3 months (C2H On W2) Job Description: Summary: Responsible for the provisioning of any IT development, analysis, Information management (DBA), or QA requiring specialized knowledge of a niche tech
Easy Apply
Posted 3 days ago | Updated 3 days ago

Data Engineer

Apex Systems

•

Hoboken, New Jersey, USA

Full-time

Job#: 2023515 Job Description: Apex Systems combines with parent company ASGN Inc. to make it the 2nd largest IT staffing agency in the country. Apex has an opportunity for a Scala Engineer . If interested in discussing the position further, please send an MS Word version of your resume to Patryk Kopczynski, . To apply please email your resume to Here are the details: Position: Scala Engineer Location: Twice a week to one of these location Hoboken, NJ Sunnyvale, CA Herndon, VA Duration: 12
Easy Apply
Posted 44 days ago | Updated 6 hours ago

AWS Data Engineer

NTT DATA Americas, Inc

•

Remote or Raleigh, North Carolina, USA

Contract

At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees have been key factors in our company s growth and market presence. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. For more than 25 years, NTT DATA Services have focused on impacting the core of your business operations with industry-leading outsourcing s
Easy Apply
Posted 60+ days ago | Updated 3 hours ago