Apply Now

Data Engineer - (BigData ,Python, PySpark, Google Cloud Platform)

Phoenix, AZ, US • Posted 3 hours ago • Updated 3 hours ago

Full Time

No Travel Required

On-site

$90,000 - $110,000/yr

Stanley David and Associates

Fitment

Dice Job Match Score™

🤯 Applying directly to the forehead...

Job Details

Skills

Big Data
Data Engineering
Google Cloud Platform
ELT
Python
PySpark

Summary

Job Title: BigData ,Python and Py Spark , Google Cloud Platform

Location: Phoenix, AZ

Job Type: Fulltime

Job Description:

Roles and Responsibilities:

Develop and maintain data pipelines using BigData processes
Focus on ingesting, storing, processing, and analyzing large datasets

Required skills and qualifications:

Design, develop, and maintain scalable ETL/ELT pipelines using PySpark, Airflow, and Google Cloud Platform-native tools.
Build and optimize data warehouses and analytics solutions in BigQuery.
Implement and manage workflow orchestration with Airflow/Cloud Composer.
Write complex SQL queries for data transformations, analytics, and performance optimization.
Ensure data reliability, security, and governance across pipelines.
Conduct performance tuning and cost optimization of BigQuery and PySpark workloads.
Collaborate with analysts and product teams to deliver reliable data solutions.
Troubleshoot, debug, and resolve production issues in large-scale data pipelines.
Contribute to best practices, reusable frameworks, and automation for data engineering.
5+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be a addon
Expert on Distributed ecosystem
Hands-on experience with programming using Python
Expert on Hadoop and Spark Architecture and its working principle
Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes),
optimizing joins while processing huge amount of data
Experience in UNIX shell scripting Ability to design and develop optimized Data pipelines for batch and real time data processing
Should have experience in analysis, design, development, testing, and implementation of system applications
Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91097129
Position Id: 8964005
Posted 3 hours ago

Company Info

About Stanley David and Associates

We strive to add value and work as true partner with our clients

Stanley David And Associates is a recruitment specialist in the area of IT and Engineering and we stay firmly in our area of expertise, doing what we love.

We know the players and the companies and invest a lot of time getting to know candidates and clients in equal measure. This ensures a swift, cost effective and perfect placement whether it s permanent or interim.

In addition we have a reputation for having the best understanding of the market landscape, for sourcing great candidates

-We have a Global Footprint with offices in 3 countries USA, UK and India.

-SDNA Global have built up an incredible reputation within the IT strategic hiring.

-We work with Tier1 and Tier 2 IT Outsourcing companies for Leadership hiring needs in UK, Europe, USA and Indian geos.

-Each SDNA member has over 5 years of experience in Talent Acquisition

-We have successfully closed roles in countries UK, USA, Germany, Sweden, Dubai, France, Netherlands, Switzerland, Austria, Hungry, Spain, Italy, Norway, Denmark, Nigeria and South Africa

-Telecom, Media and Hi-tech

-Health care and Life Sciences

-Energy and Utilities

-CPG, Retail and Transport

-Banking and Financial Services

Go to company profile

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Python Data Engineer with GenAI

Phoenix, Arizona

•

7d ago

Role :: Python Data Engineer with GenAI Location :: Phoenix, AZ Type :: Fulltime Job Description Role - Python Data Engineer with GenAI Experience Required - 4+ Years Must Have Technical/Functional Skills Build and manage scalable data pipelines on Google Cloud Platform using strong Python. Develop high performance data and AI APIs using FastAPI. Implement RAG and semantic search solutions leveraging vector stores and embeddings. Design and maintain Knowledge Graphs to enable context aware G

Easy Apply

Full-time

Depends on Experience

Data Platform Support Engineer

San Antonio, Texas

•

2d ago

Role :: Data Platform Support Engineer Location :: San Antonio, TX Type :: Fulltime Job Description Role - Data Platform Support Engineer Experience Required - 6+ Years Must Have Technical/Functional Skills Data warehousing, SQL, scripting using Linux/Python, Understanding of API integrations Familiarity with SaaS applications and Databases, Excellent oral and written communication Roles & Responsibilities Investigate and resolve complex customer issues using logs, API requests, database qu

Easy Apply

Full-time

Depends on Experience

Java Full stack Engineer with Python

Sunrise, Florida

•

7d ago

Role :: Java Full stack with Python Location :: Sunrise, FL Type :: Fulltime Job Description Must Have Technical/Functional Skills Java + Python engineer Roles & Responsibilities Need candidates experience in Java and Python technologies. Experience in the areas of Java 8, J2EE, React JS, RDBMS, Spring Boot 5 or higher, Microservice architecture and Agile experience. Design, implement, and Optimize Python-based orchestration frameworks Manipulate data from various sources / formats such as

Easy Apply

Full-time

Depends on Experience

Senior Cloud Infrastructure Engineer - Google Cloud Platform

East Hartford, Connecticut

•

Today

Job Title:Senior Cloud Infrastructure EngineerLocation:Hartford, CTJob Type:FulltimeJob Description:Must Have Technical/Functional Skills Strong hands-on experience in Google Cloud Platform (Google Cloud Platform) as a primary cloud providerWorking knowledge of AWS in a multi-cloud environmentTerraform for Infrastructure-as-Code (IaC)DevOps tools and practices including GitHub and JenkinsGoogle Cloud Platform Cloud Run, including design and automation of Disaster Recovery (DR)Google Kubernetes

Easy Apply

Full-time

110,000 - 125,000

Search all similar jobs