Senior Data Engineer Google Cloud Platform | BigQuery | Dataflow | Python | SQL
Location: Hybrid 4 Days Onsite
Experience: 5 7 Years
Employment Type: Contract / W2
Interview: 1 2 Rounds
Job Overview
We are looking for a Senior Data Engineer with strong Google Cloud Platform (Google Cloud Platform) experience to build and optimize scalable cloud data pipelines and data platforms.
The ideal candidate will have hands-on experience with BigQuery, Dataflow, DataProc, Pub/Sub, Python, and SQL, along with a strong understanding of data architecture and cloud-based data engineering best practices.
You will work closely with data architects, application teams, and business stakeholders to design and develop reliable and scalable data solutions.
Key Responsibilities
Design and develop scalable data pipelines for ingesting and processing data from multiple sources.
Build and maintain cloud-based data platforms using Google Cloud Platform (Google Cloud Platform).
Develop and optimize data pipelines using Python, SQL, and Java.
Implement data ingestion, transformation, and curation frameworks.
Utilize BigQuery, Dataflow, DataProc, Pub/Sub, and Cloud Functions to build data solutions.
Ensure data quality, governance, security, and compliance.
Monitor and optimize pipeline performance, scalability, and cost efficiency in Google Cloud Platform.
Implement Infrastructure as Code (IaC) using Terraform.
Collaborate with engineering and architecture teams to implement best practices and data engineering standards.
Document architecture, workflows, and data engineering processes.
Required Skills
5 7 years of experience in Data Engineering or Software Engineering.
Hands-on experience with Google Cloud Platform (Google Cloud Platform).
Strong expertise in:
Experience building cloud data pipelines using:
BigQuery
Dataflow
DataProc
Pub/Sub
Cloud Functions
Experience with relational databases (PostgreSQL, MySQL).
Strong understanding of microservices and Service-Oriented Architecture (SOA).
Experience with CI/CD pipelines and Infrastructure as Code tools (Terraform).
Experience optimizing performance and cost for Google Cloud Platform workloads.
Nice to Have
Experience with DBT or Dataform
Experience with Astronomer or Apache Airflow
Knowledge of data governance, encryption, and data masking
Experience working with large-scale data platforms
Education
Bachelor s degree in Computer Science, Information Technology, Data Analytics, or a related field.
Keywords (for search visibility)
Google Cloud Platform, Google Cloud Platform, Data Engineer, BigQuery, Dataflow, DataProc, Pub/Sub, Cloud Functions, Python, SQL, Java, Terraform, Data Pipelines, Data Platform, Microservices