Overview
Hybrid
Depends on Experience
Contract - W2
Contract - 3 Month(s)
Skills
SQL
GCP
google cloud Platform
Google cloud
Python
dataflow
airflow
composer
dataproc
GCP Lead
Job Details
Role: Lead Google Cloud Platform Data Engineer
Duration: 3 Months Contract
Location: Pleasanton, CA (Local only)
Note: Required minimum 10+ years Experience
Must Skill:
- Big Query, Composor, Google Cloud Platform, Dtastage, Dataproc
Required Past Experience:
- Experience in architecting, developing, testing & implementing Data Platform projects using Google Cloud Platform Components (e.g. BigQuery, Dataflow, Dataproc, DLP, BigTable, Pub/Sub, Compos etc..). OR AWS OR Azure
- Good Understanding of Data Structures.
- Worked with large datasets and solving difficult analytical problems.
- Experience working with GIT for Source Code Management
- Worked with Structured and Unstructured data
- E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management.
- Worked with client teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from the Google Cloud Platform
- Automating manual processes to speed up delivery.
- Good Understanding of Data Pipeline (Batch and Streaming) and Data Governance
- Experience in code deployment from lower environment to production.
- Good communication skills to understand business requirements.
Required Skills and Abilities:
- Mandatory Skills AWS/ Azure OR BigQuery ,Composer, Dataflow, Python/ Shell scripting, Google Cloud Platform Fundamentals, SQL
- Secondary Skills Oracle to BQ migration, IBM DS, Dataproc, DLP, Pub/Sub, , Security(Platform & Data) concepts.
- Knowledge of ETL Migration from On-Premises to Google Cloud Platform Cloud
- SQL Performance Tuning
- Batch/Streaming Data Processing
- Fundamentals of Kafka,Pub/Sub to handle real-time data feeds.
- Good To Have - Certifications in any of the following: Google Cloud Platform Professional Cloud Architect, Google Cloud Platform Professional Data Engineer
- Ability to communicate with customers, developers, and other stakeholders.
- Mentor and guide team members
- Good Presentation skills
- Strong Team Player