Google Cloud Platform Data Engineer

  • Atlanta, GA
  • Posted 4 hours ago | Updated 4 hours ago

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - Independent
Contract - 12 Month(s)

Skills

GCP
SQL
Python
Airflow

Job Details

Job Title: Google Cloud Platform Data Engineer

Location: Atlanta, GA(Hybrid 2 days a week)

Type: Both Contract(C2C) and Fulltime

Experience: 5 -10 years

 

Job Summary:

We are seeking a skilled Google Cloud Platform Data Engineer to join our growing team. The ideal candidate will have hands-on experience in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform using Apache Beam/Dataflow, Airflow, and other modern data engineering tools. You should be well-versed in backend development using Spring Boot, proficient in writing Shell scripts, and familiar with working on MongoDB for high-performance data operations.

Key Responsibilities:

  • Design and implement scalable, robust, and efficient data pipelines using Apache Beam/Dataflow.
  • Orchestrate workflows and manage DAGs using Apache Airflow on Cloud Composer.
  • Develop backend services and APIs with Spring Boot to support data processing workflows.
  • Create and maintain automation scripts in Shell for deployment, data movement, and monitoring tasks.
  • Integrate and manage MongoDB as part of the data platform, including performing CRUD operations, indexing, and performance tuning.
  • Collaborate with cross-functional teams to understand business data needs and translate them into technical solutions.
  • Optimize pipeline performance, ensure data quality, and monitor pipeline health using Google Cloud Platform-native tools.
  • Ensure secure, reliable, and cost-effective data engineering practices on the cloud.

Required Skills:

  • 5+ years of experience as a Data Engineer, with strong exposure to Google Cloud Platform services.
  • Hands-on experience in Apache Beam with Google Cloud Dataflow.
  • Experience building and managing workflows using Apache Airflow / Cloud Composer.
  • Proficiency in Shell scripting for automation and orchestration.
  • Solid development experience in Java and Spring Boot.
  • Strong working knowledge of MongoDB schema design, indexing, aggregation framework.
  • Familiarity with Google Cloud Platform services like BigQuery, Pub/Sub, Cloud Storage, and IAM.
  • Good understanding of CI/CD pipelines and version control using Git.

Preferred Qualifications:

Google Cloud Platform Certification (e.g., Professional Data Engineer or Cloud Developer) is a plus.

Knowledge of Python and SQL for data transformations and scripting.

Soft Skills:

Strong problem-solving and analytical skills.

Excellent communication and collaboration abilities.

Self-motivated with a continuous learning mindset.

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.