Here is OUR CLIENT REQUIREMENT which can be filled immediately.
Position: Senior Data Engineer – AWS to Google Cloud Platform Migration
Location: Remote, USA
Duration: Contract C2C
Visa: NO H1B
Experience: 10+ years
**Seeking a strong AWS and Google Cloud Platform candidate**
About the role
We're seeking a Senior Data Engineer to support an enterprise data platform and its migration from AWS to Google Cloud Platform (Google Cloud Platform). You'll help maintain and optimize production pipelines in AWS while building and migrating scalable data solutions on Google Cloud Platform.
The ideal candidate brings strong hands-on experience across both cloud environments, with deep expertise in Spark, PySpark, Databricks, Airflow, and SQL. You'll work with data engineering, platform, and architecture teams to deliver a reliable, high-performing modern data platform.
What you'll do
Design, build, optimize, and maintain scalable batch and distributed data pipelines.
Support AWS workloads built with Amazon S3, Amazon Redshift, Databricks, Apache Airflow, and PySpark.
Migrate data storage and processing workloads from Amazon S3 to Google Cloud Storage (GCS).
Modernize Redshift data warehouse workloads and SQL for Google BigQuery.
Develop and tune Spark and PySpark workloads on Google Cloud Dataproc.
Build and maintain Airflow DAGs, including migration and orchestration improvements.
Work with Apache Hive tables, partitions, metadata, and Spark SQL.
Protect data quality, integrity, reliability, and performance throughout migration.
Troubleshoot pipeline failures, data inconsistencies, and performance bottlenecks.
Collaborate with engineers, platform teams, architects, and business partners.
Required experience
10+ years of overall IT experience, with substantial data engineering experience.
Strong hands-on development experience with Python, PySpark, Apache Spark, and SQL.
Strong AWS data engineering experience, particularly with Amazon S3 and Redshift.
Experience with Databricks and Apache Airflow.
Hands-on experience with Google Cloud Platform services, including GCS, Dataproc, and BigQuery.
Experience migrating or modernizing data workloads across cloud platforms.
Strong understanding of distributed computing, data partitioning, query optimization, and performance tuning.
Experience with Apache Hive and large-scale data processing.
Strong debugging, problem-solving, and communication skills.
Preferred qualifications
Previous experience migrating data platforms from AWS to Google Cloud Platform.
Experience converting Redshift SQL and data models to BigQuery.
Experience migrating Spark or Databricks workloads to Dataproc.
Airflow DAG migration or orchestration modernization experience.
Knowledge of data validation, reconciliation, and migration testing.
Experience with CI/CD, Terraform, and cloud infrastructure automation.
Experience working in enterprise-scale data engineering environments.