Google Cloud Platform BigQuery Data Engineer - Onsite

  • Franklin, TN
  • Posted 1 day ago | Updated 1 day ago

Overview

On Site
Depends on Experience
Contract - W2
Contract - 8 Month(s)

Skills

ETL pipeline
dataflow
Bigquery
partitioning
clustering
SQL queries
DAG
YAML
Airflow
Python
Cloud Composer
Load data
files
streaming one record
fine-grained access control
roles
authorized views
Bigquery architecture
table partitioning
denormalized data structures
Preparing data
ETL jobs
Create
load
query partitioned tables
batch processing data

Job Details

Title: Google Cloud Platform BigQuery Data Engineer - Onsite


Mandatory skills:


ETL pipeline,
dataflow, Bigquery,
partitioning, clustering,
SQL queries,
DAG, YAML, Airflow, Python,
Cloud Composer,
BigQuery, Load data, files, streaming one record,
fine-grained access control, roles, authorized views,
Bigquery architecture, table partitioning, clustering,
denormalized data structures, Preparing data, ETL jobs,
Create, load, query partitioned tables, batch processing data


Description:


7+ Years of Experience preferred
Experience in creating ETL pipeline using dataflow & Bigquery, Experience to create best performing tables with partitioning/clustering etc enabled keeping best practices in mind
Write Complex SQL queries keeping execution cost in mind.
Hands-on with DAG using YAML or Airflow (Python)
Knowledge of Cloud Composer
Load data into BigQuery using files or by streaming one record at a time .
Create, load, and query partitioned tables for daily batch processing data.
Implement fine-grained access control using roles and authorized views.
Should have in-depth understanding of Bigquery architecture, table partitioning, clustering, best practices.
Should know how to reduce BigQuery costs by reducing the amount of data processed by your queries.
Should be able to speed up queries by using denormalized data structures, with or without nested repeated fields.
Exploring and Preparing data using BigQuery.
Implementing ETL jobs using Bigquery.

VIVA USA is an equal opportunity employer and is committed to maintaining a professional working environment that is free from discrimination and unlawful harassment. The Management, contractors, and staff of VIVA USA shall respect others without regard to race, sex, religion, age, color, creed, national or ethnic origin, physical, mental or sensory disability, marital status, sexual orientation, or status as a Vietnam-era, recently separated veteran, Active war time or campaign badge veteran, Armed forces service medal veteran, or disabled veteran. Please contact us at for any complaints, comments and suggestions.


Contact Details :

VIVA USA INC.
3601 Algonquin Road, Suite 425
Rolling Meadows, IL 60008

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About VIVA USA INC