Hiring: Google Cloud Platform Data Platform Engineer Charlotte, NC
We are building a hybrid data platform that bridges an on premises big data cluster with Google Cloud Platform and we need an engineer who can own this integration end to end This role is central to establishing a repeatable production grade pattern for multitenant data platform architecture starting with Google Cloud Platform as the first cloud tenant on an existing onprem Cloudera cluster You will configure the foundational infrastructure service accounts Iceberg table formats metadata catalog integration via Apache Gravitino and rolebased access controls
Job Title: Google Cloud Platform Data Platform Engineer
Position Type: Long Term Contract
Location: Charlotte, NC
Responsibilities:
Configure and provision the onpremises Cloudera cluster environment including service account creation role definitions and permission structures for multitenant access
Design and implement Apache Iceberg table structures optimized for hybrid onpremcloud workloads
Integrate the Iceberg REST Catalog IRC with Apache Gravitino to establish a unified metadata layer across onprem and Google Cloud Platform environments
Establish Google Cloud Platform as a production tenant on the existing onprem Cloudera cluster validating the endtoend architecture pattern
Define and enforce data access governance including rolebased permissions and service account security policies across both environments
Drive the full lifecycle from environment setup through to production deployment
Publish comprehensive documentation and architectural blueprints covering crossplatform interoperability best practices vendor recommendations and access patterns for hybrid data lake implementations
REQUIREMENTS
5 years of relevant experience in data platform engineering
Handson experience with Google Cloud Platform Google Cloud Platform
Experience with onpremises Cloudera big data clusters
Experience with Apache Iceberg table format
Experience with Iceberg REST Catalog IRC
Experience with Apache Gravitino for metadata catalog integration
Experience with service account creation and rolebased access control in hybrid environments
Skills Required
Google Cloud Platform Cloudera Apache Iceberg Iceberg REST Catalog Apache Gravitino Service Account Management Role Based Access Control Hybrid Data Platform Architecture Multi Tenant Data Platform
Setup DPC environment create a service account Iceberg tables IRC with Gravitino DPC roles and permissions existing DPC cluster with Google Cloud Platform as one of the tenants to establish this pattern and take it all the way to production
Setup Google Cloud Platform environment create a service account Iceberg tables IRC Google Cloud Platform IAM roles and permissions existing Google Cloud Platform project GDWdev4 project to establish this pattern and take it all the way to production
Get IRC from DPC and Google Cloud Platform to sync with each other it can be one or more IRC from DPC and Google Cloud Platform
DPC and Google Cloud Platform platform should have the ability
Establish the pattern on interoperability for data access between DPC and Google Cloud Platform for Iceberg tables
Put the governance and guardrails around this access patterns and persona mapping on Google Cloud Platform side
Publish document and blueprints on this cross platform interoperability best practices vendor recommendations and access patterns
Interested or open to new opportunities?
Please send your updated resume with contact details to
Thanks and Regards
Vikas Mahindrakar
Direct:
New York Technology Partners
120 Wood Avenue S | Suite 504 | Iselin, NJ 08830
Never miss an opportunity! Create an alert based on the job you applied for.
