Job Title : Google Cloud Platform Data Platform Engineer
Location : USA (Remote)
Job Type : Contract -W2
Job Description:
Administer, configure, maintain and upgrade Google Cloud Platform Composer (Apache Airflow) environment ( Mandatory )
Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources. (Mandatory)
Able to create Terraform modules and publish same in TFE (Terraform Enterprise )
DAG deployment, Troubleshooting, performance tuning, and operational support.
Support and optimize Dataflow and Dataproc workloads, including batch and streaming data processing pipelines.
Maintain Google Cloud Platform infrastructure including services like:
Google Cloud Platform Composer (Apache Airflow)
Google Cloud Storage (GCS)
BigQuery (BQ)
Cloud Dataflow /Apache Beam
Cloud Dataproc
Cloud Functions --- (Mandatory)
Cloud Run
Pub/Sub
Cloud SQL
Secret Manager
Logging & Monitoring
Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.
Set up and manage alerting by Creating Alert policies in Google Cloud Platform Monitoring . (Mandatory)
Manage CI/CD pipelines using Jenkins and/or using other CI/CD tools.(Mandatory)
Able to request Identity and Access Management (IAM) permissions, service accounts, and security policies following least-privilege principles.
Ensure security, compliance, and cost-efficiency across the cloud environment.
Monitor cloud infrastructure health, performance, and resource utilization using Cloud Monitoring, Cloud Logging, Error Reporting, and Cloud Trace.
Develop automation scripts and operational tools using Python and/or Java to improve platform efficiency and reduce manual effort.
Create and maintain operational documentation, runbooks, architecture diagrams, standard operating procedures (SOPs), and platform best practices.
Excellent problem-solving and troubleshooting skills.
Nice to Have Skills:
Experience with CDC platforms such as Striim
Experience with ServiceNow integrations and operational workflows
Knowledge of FinOps, cloud cost optimization, and governance frameworks
Networking components understanding including:
VPCs and Shared VPCs
VPC Connectors
Firewall Rules
CIDR Ranges
Exposure to healthcare domain.
