hadoop pyspark data pipeline build engineer Jobs

Refine Results
1 - 20 of 608 Jobs

Senior Data Engineer (Hadoop/PySpark)

SSI People

•

Cleveland, Ohio, USA

Contract

Join our dynamic team as a Senior Data Engineer on a contract basis, with potential for full-time employment. This role offers a hybrid work model, with three days in the office and two days remote. Job Responsibilities: Participate in daily standups, sprint planning, and sprint retrospective sessions.Engage in coding development and unit testing.Modify existing databases and database management systems.Coordinate database development within a project team.Estimate time and cost for project requ
Easy Apply
Posted 11 days ago | Updated 11 days ago

Pyspark Data Engineer / Pyspark Developer

KPI Partners, Inc.

•

Remote

Contract

8-10 Years of total experience collaborating with cross-functional teams, including machine learning engineers, software developers, analytics engineers, and product managers to translate business requirements into highly available data solutions3+ years of experience developing and implementing data pipelines using PySpark.Proven experience with SQLProven experience with SQLBe an independent self-learner with the let s get this done approach and ability to work in Fast paced and Dynamic envir
Easy Apply
Posted 2 days ago

Senior Azure Data Architect/Engineer with PySpark with 12+ years working experience

SANS

•

Edison, New Jersey, USA

Full-time

Please DO NOT send your resume if you have LESS THAN 12 years of professional experinece. We are seeking senior candidates with 13+20 years of database development experience. Must be expert with DataBricks and PySpark. Job Title - Azure Data Solutions Architect Location - Edison, NJ Position: Fulltime (W2); Company will sponsor H1B Visas for full-time Job Summary: We are seeking an experienced Azure Data Solutions Architect with P&C Industry experience. If you are data freak and looking for
Easy Apply
Posted 10 days ago | Updated 5 days ago

Data Engineer- Python, PySpark, Java

ApTask

•

Dallas, Texas, USA

Full-time

Technical/Functional Skills Frameworks: Spark, PySpark, Python, Apache Airflow and Cassandra, Sprint Boot Micro Services, Apache Camel, Angular 6 UI FrameworkDB: Postgres DB, OracleDevOps: GITLAB, Jenkins, Maven, Confluence, Jfrog Artifactory, SONARQUBE, JIRA Experience Required Must have strong experience in Spark, PySpark, Python, Apache Airflow and Cassandra.Must have strong experience in Apache Flink, Python, Apache Kafka and CassandraBuild near real time data pipeline with Apache Spark, Py
Easy Apply
Posted 30 days ago

Sr Data Engineer (Pyspark/AWS/Databricks)

Wizcom Corporation

•

Plano, Texas, USA

Contract

Sr Data Engineer (Pyspark/AWS/Databricks) Plano TX (Hybrid Role) Relocation can be considered W2 only (No C2C) Pre-screen must be on Pyspark & AWS, Databricks. I need someone with React, AWS & Pyspark with Databricks experience - THESE ARE MUST HAVE SKILLS Looking for 10+ years experience Formal training or certification on software engineering concepts and 8+ years of applied experience Hands-on practical experience delivering system design, application development, testing, and operational
Easy Apply
Posted 4 days ago | Updated 1 day ago

Data Engineer with PySpark

Hexplora

•

Rocky Hill, Connecticut, USA

Full-time, Contract

Job Title: Data Engineer with PySpark -W2 only Location: Rancho Cucamonga,CA/ (Onsite Role) We are open for Visa Sponsorship As a Data Engineer, you will play a key role in designing and implementing robust data pipelines and infrastructure to support our data-driven initiatives. Key Responsibilities: Design, develop, and maintain scalable data pipelines using PySpark. Collaborate with data scientists and analysts to understand data requirements and implement solutions. Parse JSON files to SQL T
Easy Apply
Posted 25 days ago | Updated 7 hours ago

Lead Software Engineer (Pyspark/Data/Snowflake/AWS Lead)

JPMorgan Chase & Co.

•

Wilmington, Delaware, USA

Full-time

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Home Lending and Auto Technology , you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technica
Posted 53 days ago | Updated 7 hours ago

W2 Only - Data Engineer (Python, React, Hadoop & Cloud)

New Millennium Consulting

•

Plano, Texas, USA

Contract

One of our Fortune 100 clients in Plano, TX is looking for a Full Stack Data Engineer/Developer. Title: Full Stack Data Engineer / Developer Location: Plano, TX (Fri Remote) Hourly: $70 per hour (W2) Duration: 1 year (Contract-to-Hire) Stack Experience: Minimum 5 years of Full Stack expertise in one of the following stacks and comfortable exploring others MERN stack: JavaScript - MongoDB - Express - ReactJS - Node.js (Preferred)MEAN stack: JavaScript - MongoDB - Express - AngularJS - Node.jsLAMP
Easy Apply
Posted 60+ days ago | Updated 17 days ago

Data Engineer/ Spark Developer

Nityo Infotech Corporation

•

Austin, Texas, USA

Full-time

Role - Data Engineer/ Spark Developer Experience 5+ years of IT experience Location Austin, TX/ Sunnyvale, CA Employment Type Fulltime Job Description : Required Qualifications: Bachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of educationAt least 5 years of experience in Information Technology.At least 2 years of experience with Spark required.At least 2 years of expe
Easy Apply
Posted 2 days ago

Data Engineer - ETL, Databricks, PySpark, SQL

Travelers

•

Hartford, Connecticut, USA

Full-time

Who Are We? Taking care of our customers, our communities and each other. That's the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 160 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what you do and where you do it. Compensation Overview The annual base salary range provided for this position is a nationwide market range and re
Posted 60+ days ago | Updated 7 hours ago

Data Pipeline Engineer- Scala, Spark, AWS - Major Entertainment Company

TechLink Resources

•

Remote

Contract

Looking for a Software / Data Engineer strong with Scala, Spark, AWS, and object oriented programming. This team is under the Ads Platform team and you will be responsible of a large - scale data platform for real - time and batch processing. Must have skills: Spark, Scala, Spring/Springboot/Scala3-5 years general experience in addition to having experience in production- having worked at a company in prod environments- Operationalize and productionize of systems having worked on bothAd targetin
Easy Apply
Posted 60+ days ago | Updated 3 days ago

Data Engineer in Phoenix AZ, Chandler AZ, Dallas TX(Hybrid)- Only W2 canddidates

Saksoft

•

Dallas, Texas, USA

Contract

Data Engineer Hybrid from one of the following areas: Phoenix AZ, Chandler AZ, Dallas TX 6 month contract (with potential to extend) Only W2 canddidates Required Skills- SQL Server Experience SSIS PySpark Details This position is responsible for Data Engineering and Security. this role covers jobs which develop database architectures to address business needs, ensuring system security, performance and reliability. They will Lead complex/large data delivery initiatives with broad cybersecurity
Easy Apply
Posted 9 days ago | Updated 9 days ago

Data Architect - Manufacturing

Pozent

•

New York, New York, USA

Contract

12 month contract Remote 100 percentProject description Applying to the position, you may join one of the most respected and fastest growing institutional investors in the world. Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability. The company invests in all major asset classes, including public equity, private equity, real estate, infrastructure and fixed-income instruments. Client attracts and selects high-calibre i
Easy Apply
Posted 9 days ago | Updated 7 hours ago

Principal Data Engineer -53328

PRIMUS Global Services Inc.

•

Bellevue, Washington, USA

Contract, Third Party

Principal Data Engineer -53328 We have an immediate long-term opportunity with one of our largest clients for a position of Principal Data Engineer, to work in Bellevue WA Responsibilities: Utilize Azure services including ADF for orchestration, ADLS for storage, and AzureDevOps for CI/CD. Design, develop, and maintain ETL processes leveraging Databricks and Spark. Write and maintain PowerShell scripts for automation tasks. Utilize SQL (TSQL, PostgreSQL) for data manipulation and querying. Wor
Easy Apply
Posted 22 days ago | Updated 2 hours ago

Sr. AZURE Data Engineer/Architect-PYTHON & PYSPARK

Long Finch Technologies

•

Remote

Contract, Third Party

Hands on Interview on SQL, Python, Pyspark. Must have Skills : Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, Google Cloud Platform, Data Bricks etc. Azure experience is preferred over other cloud platforms.12 + years of proven IT exp.experience with SQL, schema design and dimensional data modelling. Hands on experience in SQL is a MUST.Solid knowledge of data warehouse best practices, development standards and me
Easy Apply
Posted 60+ days ago | Updated 2 days ago

Snowflake Data Engineer

Cygnus Professionals

•

Austin, Texas, USA

Contract

Data Engineer _ Snowflake Lead Austin, TX (Day one on site) / Sunnyvale, CA We need strong data folks with Snowflake, Python, SQL. Requirements: SnowflakeData ModelingPySparkPythonSQLDatawarehouseAWS good to haveGood communication skill Role and Qualification Snowflake Data Engineers are required to have the following qualifications:Minimum of 10+ year of experience designing and implementing a full-scale data warehouse solution based on Snowflake.A minimum of three years experience in develo
Easy Apply
Posted 11 days ago

Senior Data Engineer - Virginia | Fulltime Only - Onsite | Wissen Technology

Wissen Infotech

•

Richmond, Virginia, USA

Full-time

Data Engineer- FTE, Wissen Technology, Virginia - Hybrid The Wissen team continues to expand its footprint in the US. More openings to come as we continue to grow the team! Please read below for a brilliant career opportunity. Please do not apply if you do not fit the grid. Role: Data Engineer / 8-10 Years required Title: Associate/AVP Location: Virginia(Day 1 Onsite/Hybrid) Fulltime Mode of Work: 3 days/week onsite required Your required skills: 8-10 Years Required Skills: Bachelor's degree in
Easy Apply
Posted 5 days ago | Updated 3 days ago

Data Engineer

Softpath System, LLC.

•

Richmond, Virginia, USA

Contract

Job Details: Job Title : Data Engineer Location : Richmond, VA Duration : 12 Months Contract - with intent to extend contingent on project need/performance. Schedule: Hybrid In office every other week Job Description: Qualifications 1. Minimum 5 years working experience as Data Analyst 2. Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts 3. Minimum 5 years working experience in SQL, Stored Procedures and Table Design 4. Minimum 5 years working expe
Easy Apply
Posted 15 days ago

Data Engineer

Kforce Technology Staffing

•

Remote or Blue Ash, Ohio, USA

Contract, Third Party

RESPONSIBILITIES: Kforce has a client in Blue Ash, OH that is seeking a Data Engineer. Summary: We develop strategies and solutions to ingest, store, and distribute our big data. Our developers use Big Data technologies including (but not limited to) Hadoop, Pyspark, Hive, JSON, and SQL to develop products, tools and software features. REQUIREMENTS: * Bachelor's degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM) * 4+ years of professional Data D
Posted 2 days ago | Updated 3 hours ago

Full Time Position: AWS Data Engineer -- Indianapolis, IN (Onsite)

Siri Infosolutions Inc

•

Indianapolis, Indiana, USA

Full-time

Hello, Hope you are doing well. Please go through the Job Description and let me know your interest. Job Title: AWS Data Engineer Location: Indianapolis, IN (Onsite) Duration: Full Time Technical Skills: Python Programming: Strong proficiency in Python for data manipulation, scripting, and ETL tasks. AWS Services: Experience with AWS services such as Glue, Lambda, S3, Redshift, and EMR. Big Data Technologies: Familiarity with big data technologies like Hadoop, Hive, and Spark. Data Modeling:
Easy Apply
Posted 4 days ago | Updated 1 hour ago