Google Cloud Platform Data Platform Consultant
Remote
Job Description-
Administer, configure, maintain and upgrade Google Cloud Platform Composer (Apache Airflow) environment ( Mandatory )
• Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources. (Mandatory)
• Able to create Terraform modules and publish same in TFE (Terraform Enterprise )
• DAG deployment, Troubleshooting, performance tuning, and operational support.
• Support and optimize Dataflow and Dataproc workloads, including batch and streaming data processing pipelines.
• Maintain Google Cloud Platform infrastructure including services like:
o Google Cloud Platform Composer (Apache Airflow)
o Google Cloud Storage (GCS)
o BigQuery (BQ)
o Cloud Dataflow /Apache Beam
o Cloud Dataproc
o Cloud Functions --- (Mandatory)
o Cloud Run
o Pub/Sub
o Cloud SQL
o Secret Manager
o Logging & Monitoring
• Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.
• Set up and manage alerting by Creating Alert policies in Google Cloud Platform Monitoring . (Mandatory)
• Manage CI/CD pipelines using Jenkins and/or using other CI/CD tools.(Mandatory)
• Able to request Identity and Access Management (IAM) permissions, service accounts, and security policies following least-privilege principles.
• Ensure security, compliance, and cost-efficiency across the cloud environment.
• Monitor cloud infrastructure health, performance, and resource utilization using Cloud Monitoring, Cloud Logging, Error Reporting, and Cloud Trace.
• Develop automation scripts and operational tools using Python and/or Java to improve platform efficiency and reduce manual effort.
• Create and maintain operational documentation, runbooks, architecture diagrams, standard operating procedures (SOPs), and platform best practices.
• Excellent problem-solving and troubleshooting skills.
Nice to Have Skills:
• Experience with CDC platforms such as Striim
• Experience with ServiceNow integrations and operational workflows
• Knowledge of FinOps, cloud cost optimization, and governance frameworks
• Networking components understanding including:
o VPCs and Shared VPCs
o VPC Connectors
o Firewall Rules
o CIDR Ranges
• Exposure to healthcare domain.
