Google Cloud Platform Data Lead

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Extract
Transform
Load
Apache Hadoop
Apache Spark
Continuous Integration and Development
Data Loading
Data Engineering
Google Cloud
MapReduce
NoSQL
PySpark
Python
Scripting Language
Clustering
Data Visualization
ELT
Apache Hive
Big Data

Job Details

Job Title: Google Cloud Platform Data Lead
Location: El Segundo, CA (Remote not allowed, need only local profiles)
Duration: 6+ Month


Job Description:
Good communication skills
Has done data lead / architect role in the past.
Has worked in the past as architect in the past.
Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (Google Cloud Platform) data sets and building data pipelines.
Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG etc.).
Python Programming Expert PySpark, Pandas
Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling)
Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting and languages (YAML, Python).
Experience in DBT to create the lineage in Google Cloud Platform. Optional
Worked in Dev-Sec-Ops (CICD) environment.
Design and develop the ETL ELT framework using BigQuery, Expertise in Big Query concepts like Nested Queries, Clustering, Partitioning, etc.
Experience in Data Integration, Data Transformation, Data Quality and Data Lineage tools.
Should be able to automate the data load from Big Query using APIs or scripting language.
E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management.
E2E Solution Design skills Prototyping, Usability testing and data visualization literacy.
Experience with SQL and NoSQL modern data stores.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About Octigo Solutions Inc