Senior Data Engineer – AWS to Google Cloud Platform Migration

Remote • Posted 2 hours ago • Updated 2 hours ago
Contract W2
Contract Independent
12 Months
No Travel Required
Remote
$50 - $55/hr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • Data Engineer
  • AWS
  • Google Cloud Platform
  • GCP
  • PySpark
  • Databricks
  • Airflow

Summary

Here is OUR CLIENT REQUIREMENT which can be filled immediately.

Position: Senior Data Engineer – AWS to Google Cloud Platform Migration
Location: Remote, USA  
Duration: Contract C2C
Visa: NO H1B
Experience: 10+ years  

**Seeking a strong AWS and Google Cloud Platform candidate**

About the role
We're seeking a Senior Data Engineer to support an enterprise data platform and its migration from AWS to Google Cloud Platform (Google Cloud Platform). You'll help maintain and optimize production pipelines in AWS while building and migrating scalable data solutions on Google Cloud Platform.
The ideal candidate brings strong hands-on experience across both cloud environments, with deep expertise in Spark, PySpark, Databricks, Airflow, and SQL. You'll work with data engineering, platform, and architecture teams to deliver a reliable, high-performing modern data platform.

What you'll do
Design, build, optimize, and maintain scalable batch and distributed data pipelines.
Support AWS workloads built with Amazon S3, Amazon Redshift, Databricks, Apache Airflow, and PySpark.
Migrate data storage and processing workloads from Amazon S3 to Google Cloud Storage (GCS).
Modernize Redshift data warehouse workloads and SQL for Google BigQuery.
Develop and tune Spark and PySpark workloads on Google Cloud Dataproc.
Build and maintain Airflow DAGs, including migration and orchestration improvements.
Work with Apache Hive tables, partitions, metadata, and Spark SQL.
Protect data quality, integrity, reliability, and performance throughout migration.
Troubleshoot pipeline failures, data inconsistencies, and performance bottlenecks.
Collaborate with engineers, platform teams, architects, and business partners.

Required experience
10+ years of overall IT experience, with substantial data engineering experience.
Strong hands-on development experience with Python, PySpark, Apache Spark, and SQL.
Strong AWS data engineering experience, particularly with Amazon S3 and Redshift.
Experience with Databricks and Apache Airflow.
Hands-on experience with Google Cloud Platform services, including GCS, Dataproc, and BigQuery.
Experience migrating or modernizing data workloads across cloud platforms.
Strong understanding of distributed computing, data partitioning, query optimization, and performance tuning.
Experience with Apache Hive and large-scale data processing.
Strong debugging, problem-solving, and communication skills.

Preferred qualifications
Previous experience migrating data platforms from AWS to Google Cloud Platform.
Experience converting Redshift SQL and data models to BigQuery.
Experience migrating Spark or Databricks workloads to Dataproc.
Airflow DAG migration or orchestration modernization experience.
Knowledge of data validation, reconciliation, and migration testing.
Experience with CI/CD, Terraform, and cloud infrastructure automation.
Experience working in enterprise-scale data engineering environments.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91139017
  • Position Id: 9146080
  • Posted 2 hours ago
Contact the job poster
AS

Arvind Subramanian

Recruiter @ Proventus Metrics

Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.