Overview
Remote
Depends on Experience
Full Time
Skills
Data Modeling
Continuous Delivery
Continuous Integration
Data Loading
Data Migration
Data Processing
Agile
Bitbucket
Cloud Computing
Health Care
Job Scheduling
Good Clinical Practice
Data Quality
Extract
Transform
Load
GCP
Data Engineer
Job Details
Job Title: Google Cloud Platform Data Engineer
Location : Remote
Year of Experience :7 to 10 Years
FTE
Job Details
Working with Dataflow typically focuses on designing, building, and maintaining data processing systems for both Data Lense and Data Verse development. Should have ability to understand the data model and healthcare Provider knowledge. Should work with Data Modeler, Customer, Data Engg USA , Team in INDIA as well as doing the pipeline test. Will be fully involved into Parallel Data Loading process apart from the Data Pipeline creation.
Job Responsibilities:
- Develop and implement data pipelines using Google Cloud Dataflow.
- Optimize data processing workflows for performance and cost efficiency.
- Collaborate with IBM UDMH Data Modeler and analysts to understand data requirements.
- Ensure data quality and integrity throughout the pipeline.
Required Skills:
- Google Cloud Dataflow
- Python and Java (Strong experience is mandatory)
Primary Skills:
- BigQuery, SQL, ETL, Cloud Functions, Data flow, Airflow
- 10+ years of IT experience with strong expertise in BigQuery and SQL.
- Hands-on experience in ETL and data migration.
- Mastery of Google Cloud Platform (Google Cloud Platform) and related services including:
- Cloud Dataflow ,Cloud Pub/Sub ,Cloud Storage, Google Composer
- Solid understanding of Git and Git workflows (GitHub, GitLab, Bitbucket).
- Experience working in Agile environments and CI/CD pipelines.
- Ability to collaborate with business stakeholders and product managers to prioritize and deliver tasks.
- Handle admin activities like project setup, user access, and job scheduling.
- Write and test scripts using:
- Unix Shell scripting
- Oracle PL/SQL
- Conduct unit testing and validation"
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.