Overview
Remote
On Site
Hybrid
$$60 / hr
Contract - W2
Contract - 1 day((s))
Skills
GCP Data Engineer
Job Details
Job Description:
- The Google Cloud Platform Data Engineer will work iteratively on the cloud platform to design, develop and implement scalable, high performance solutions that offer measurable business value to customers.
- Data Solutions: Design and implementation of data pipelines using Google Cloud Platform services
- Manage Deployments with Helm and Kubernetes: Oversee containerized deployments of data applications on Kubernetes Engine using Helm for package management, ensuring efficient orchestration of services.
- Automation with Jenkins: Implement CI/CD pipelines using Jenkins to automate data pipeline deployment, testing, and integration with other services, ensuring quick iterations and deployments.
- Develop and Optimize Pipelines: Write efficient Python and SQL scripts to build data pipelines and ETL/ELT processes.
- Continuously monitor and optimize data workflows for performance and cost-effectiveness.
- Data Integration and Orchestration: Design workflows to integrate data from various sources using Google Cloud Platform services, and orchestrate complex tasks with Cloud Composer (Apache Airflow).
- Security and Compliance: Ensure data security and compliance by implementing IAM policies, encryption, and other security measures in Google Cloud Platform, adhering to best practices for handling sensitive data.
- Collaborate Across Teams: Work closely with application developers, data architects, and business stakeholders to define and deliver robust data-driven solutions.
- Provide technical leadership and ensure alignment between business and technical objectives.
- Monitoring and Logging: Set up monitoring, logging, and alerting using Cloud Monitoring (formerly Stackdriver), Datadog, or other tools to ensure visibility into pipeline performance and quickly identify and resolve issues.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.