Certified - Google Cloud Platform Data Platform Engineer

Charlotte, NC, US • Posted 2 hours ago • Updated 2 hours ago
Contract Independent
Contract W2
12 Months
On-site
$60 - $65/hr
Fitment

Dice Job Match Score™

👾 Reticulating splines...

Job Details

Skills

  • GCP

Summary

JOB DESCRIPTION:

Google Cloud Platform DATA PLATFORM ENGINEER
Wells Fargo Fulltime MidSenior Level Onsite

ABOUT THE ROLE
We are building a hybrid data platform that bridges an onpremises big data cluster with Google Cloud Platform and we need an engineer who can own this integration end to end This role is central to establishing a repeatable productiongrade pattern for multitenant data platform architecture starting with Google Cloud Platform as the first cloud tenant on an existing onprem Cloudera cluster You will configure the foundational infrastructure service accounts Iceberg table formats metadata catalog integration via Apache Gravitino and rolebased access controls

KEY RESPONSIBILITIES
Configure and provision the onpremises Cloudera cluster environment including service account creation role definitions and permission structures for multitenant access
Design and implement Apache Iceberg table structures optimized for hybrid onpremcloud workloads
Integrate the Iceberg REST Catalog IRC with Apache Gravitino to establish a unified metadata layer across onprem and Google Cloud Platform environments
Establish Google Cloud Platform as a production tenant on the existing onprem Cloudera cluster validating the endtoend architecture pattern
Define and enforce data access governance including rolebased permissions and service account security policies across both environments
Drive the full lifecycle from environment setup through to production deployment
Publish comprehensive documentation and architectural blueprints covering crossplatform interoperability best practices vendor recommendations and access patterns for hybrid data lake implementations

REQUIREMENTS
5 years of relevant experience in data platform engineering
Handson experience with Google Cloud Platform Google Cloud Platform
Experience with onpremises Cloudera big data clusters
Experience with Apache Iceberg table format
Experience with Iceberg REST Catalog IRC
Experience with Apache Gravitino for metadata catalog integration
Experience with service account creation and rolebased access control in hybrid environments

SKILLS REQUIRED
Google Cloud Platform Cloudera Apache Iceberg Iceberg REST Catalog Apache Gravitino Service Account Management RoleBased Access Control Hybrid Data Platform Architecture MultiTenant Data Platform

EXPERIENCE 5 years



From the Client


1 Setup DPC environment create a service account Iceberg tables IRC with Gravitino DPC roles and permissions existing DPC cluster with Google Cloud Platform as one of the tenants to establish this pattern and take it all the way to production
2 Setup Google Cloud Platform environment create a service account Iceberg tables IRC Google Cloud Platform IAM roles and permissions existing Google Cloud Platform project GDWdev4 project to establish this pattern and take it all the way to production
3 Get IRC from DPC and Google Cloud Platform to sync with each other it can be one or more IRC from DPC and Google Cloud Platform
4 DPC and Google Cloud Platform platform should have the ability
5 Establish the pattern on interoperability for data access between DPC and Google Cloud Platform for Iceberg tables
6 Put the governance and guardrails around this access patterns and persona mapping on Google Cloud Platform side
7 Publish document and blueprints on this cross platform interoperability best practices vendor recommendations and access patterns

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 10119106
  • Position Id: 9047689
  • Posted 2 hours ago
Contact the job poster
AJ

Aakash Jadhav

Recruiter @ New York Technology Partners
Create job alert
Set job alertNever miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Charlotte, North Carolina

Today

Easy Apply

Contract

Depends on Experience

Charlotte, North Carolina

Today

Easy Apply

Full-time

$85 - $110 per hour

Charlotte, North Carolina

Today

Contract

USD 68.00 - 73.00 per hour

North Carolina

Today

Easy Apply

Contract, Third Party

Search all similar jobs