Lead Google Cloud Platform Data Engineer (Local only)

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 3 Month(s)

Skills

SQL
GCP
google cloud Platform
Google cloud
Python
dataflow
airflow
composer
dataproc
GCP Lead

Job Details

Role: Lead Google Cloud Platform Data Engineer

Duration: 3 Months Contract

Location: Pleasanton, CA (Local only)

Note: Required minimum 10+ years Experience

Must Skill:

  • Big Query, Composor, Google Cloud Platform, Dtastage, Dataproc

Required Past Experience:

  • Experience in architecting, developing, testing & implementing Data Platform projects using Google Cloud Platform Components (e.g. BigQuery, Dataflow, Dataproc, DLP, BigTable, Pub/Sub, Compos etc..). OR AWS OR Azure
  • Good Understanding of Data Structures.
  • Worked with large datasets and solving difficult analytical problems.
  • Experience working with GIT for Source Code Management
  • Worked with Structured and Unstructured data
  • E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management.
  • Worked with client teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from the Google Cloud Platform
  • Automating manual processes to speed up delivery.
  • Good Understanding of Data Pipeline (Batch and Streaming) and Data Governance
  • Experience in code deployment from lower environment to production.
  • Good communication skills to understand business requirements.

Required Skills and Abilities:

  • Mandatory Skills AWS/ Azure OR BigQuery ,Composer, Dataflow, Python/ Shell scripting, Google Cloud Platform Fundamentals, SQL
  • Secondary Skills Oracle to BQ migration, IBM DS, Dataproc, DLP, Pub/Sub, , Security(Platform & Data) concepts.
  • Knowledge of ETL Migration from On-Premises to Google Cloud Platform Cloud
  • SQL Performance Tuning
  • Batch/Streaming Data Processing
  • Fundamentals of Kafka,Pub/Sub to handle real-time data feeds.
  • Good To Have - Certifications in any of the following: Google Cloud Platform Professional Cloud Architect, Google Cloud Platform Professional Data Engineer
  • Ability to communicate with customers, developers, and other stakeholders.
  • Mentor and guide team members
  • Good Presentation skills
  • Strong Team Player