Google Cloud Platform Data Engineer

Overview

Remote
$1 - $2
Full Time
100% Travel

Skills

GCP
Compute Engine
Data Proc
Kubernetes Engine
Cloud Storage
BigQuery
PUB/SUB
Cloud Functions
Dataflow
PySpark
Python
Spark SQL
DataFrames
PyTest
Jenkins
GitHub
SQL
ETL

Job Details

  • Experience with Google Cloud Platform services such as Compute Engine, Data Proc, Kubernetes Engine, Cloud Storage, BigQuery, PUB/SUB, Cloud Functions and Dataflow.

  • Cloud Composer, ETL experience working with large data sets, PySpark, Python, Spark SQL, DataFrames, PyTest

  • Develop and implement proactive monitoring and alert mechanism for data issues.

  • Familiarity with CI/CD pipelines and automation tools such as Jenkins, GitHub & GitHub actions.

  • Able to write complex SQL queries for business results computation

  • Develop architecture recommendations based on Google Cloud Platform best practices and industry standards.

  • Work through all stages of a data solution life cycle: analyze/profile data, create conceptual, logical & physical data model designs, architect and design ETL, reporting, and analytics solutions.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.