Principal Data Architect or Google Cloud Platform Big Query Data Architect

Overview

On Site
Depends on Experience
Full Time
Accepts corp to corp applications

Skills

Bigquery
spark
ETL
ELT
SQL
GCP

Job Details

Job description:

  • 10+ years of experience in data architecture, data engineering, or cloud engineering with a focus on designing large-scale data solutions.
  • 3+ year(s) experience of hands-on experience with Google Cloud Platform platform and experience with many of the following components:
    • BigQuery, Cloud Storage, Dataflow
    • Cloud Run, GKE, Cloud Functions
    • Spark Streaming, Kafka, Pub/Sub
    • Bigtable, Cloud SQL, Cloud Spanner
    • JSON, Avro, Parquet, Iceberg, Delta formats
    • Cloud Composer, DataProc, CI/CD, Cloud Logging
    • Vertex AI, Pydantic, LangChain, FastAPI, Docker
  • Extensive experience in designing and managing data warehouses, data lakes, and cloud-based data ecosystems.
  • Expertise in ETL/ELT tools and technologies, with a strong background in automating data pipelines.
  • Strong programming skills in Python, Java, Scala, SQL, and/or other relevant languages for data engineering.
  • Experience with DevOps and automation tools for deploying and managing data solutions in the cloud.
  • Knowledge of data security, privacy, and compliance regulations (GDPR, HIPAA, etc.) within the context of cloud data architectures.
  • Experience with Oracle, SQL Server, and other database platforms.
  • Adeptness to learn new assignments, technologies, and applications quickly and manage multiple assignments simultaneously.
  • Ability to troubleshoot, maintain, reverse engineer, and optimize existing ETL pipelines.
  • Ability to analyze and interpret complex data and offer solutions to complex clinical problems.
  • Ability to work independently on assigned tasks.
  • Strong written and verbal communication skills including the ability to explain complex technical issues in a way that non-technical people may understand.
  • Certifications (a plus, but not required):
  • Google Cloud Platform Professional Data Engineer
  • Google Cloud Platform Professional Cloud Architect

PHYSICAL DEMANDS/WORKING CONDITIONS (Specific statements of physical effort required and description of work environment; e.g., prolonged sitting at CRT. required travel %)

  • Prolonged sitting or standing at computer workstation including use of mouse, keyboard, and monitor.
  • Requires ability to provide after-hours support.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.