QUANTUM TECHNOLOGIES LLC
QUANTUM TECHNOLOGIES LLC

Data Engineer with Azure-to-Google Cloud Platform Migration exp

Hybrid in Atlanta, GA, US • Posted 8 hours ago • Updated 8 hours ago
Contract Independent
6 Months
No Travel Required
Able to Sponsor
Hybrid
$70,000 - $120,000/yr
Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

  • GCP
  • Google Cloud Pub/Sub
  • Dataflow
  • Apache Beam
  • BigQuery
  • Cloud Spanner
  • Python
  • SQL
  • PySpark
  • Apache Spark
  • Databricks
  • Delta Lake
  • CDC
  • SCD Type 2
  • ETL/ELT
  • Data Modeling
  • Clickstream Processing
  • Snowflake
  • Azure Data Factory
  • Azure Event Hubs
  • Cosmos DB
  • Terraform
  • CI/CD
  • Cloud Run
  • Dataproc
  • Cloud Composer
  • Apache Airflow
  • REST API
  • GraphQL
  • Data Quality
  • Dataplex
  • Unity Catalog
  • IAM
  • VPC Service Controls
  • Cloud Migration.

Summary

Job Title: Data Engineer with Azure-to-Google Cloud Platform Migration exp
Location:Atlanta, GA
Duration: 6 Months + Extension
Bill Rate: $76/hour
Job Type: C2C/1099 Contract
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description :

  • Design and develop real-time data pipelines using Google Cloud Platform Pub/Sub, Dataflow, and Apache Beam.

  • Build scalable data ingestion pipelines to process streaming data into BigQuery and Cloud Spanner.

  • Implement CDC, SCD Type 2, clickstream ingestion, and late-arriving data processing.

  • Develop and optimize BigQuery SQL queries, partitioning, clustering, and cost management.

  • Design Cloud Spanner schemas, primary keys, indexes, change streams, and low-latency data access.

  • Build data synchronization and reverse ETL pipelines between BigQuery and Cloud Spanner.

  • Migrate existing data pipelines from Microsoft Azure to Google Cloud Platform using Azure Data Factory, Databricks, and Snowflake.

  • Work with Azure Event Hubs, Cosmos DB, Redis, and Azure Functions during cloud migration projects.

  • Develop data transformation workflows using Python, SQL, PySpark, Apache Spark, and Delta Lake.

  • Implement dimensional modeling, Data Vault, medallion architecture, and incremental ETL/ELT processes.

  • Build customer knowledge graph pipelines, identity resolution, and Customer 360 data solutions.

  • Develop data feeds for REST, gRPC, and GraphQL APIs, supporting AI applications and MCP servers.

  • Implement data quality, lineage, governance, and security using Dataplex, Unity Catalog, IAM, and VPC Service Controls.

  • Automate infrastructure deployment using Terraform, CI/CD, Cloud Run, Dataproc, and Cloud Composer.

  • Monitor production pipelines, troubleshoot failures, optimize performance and costs, implement testing, and maintain operational SLAs/SLOs.

Equal Opportunity Employer:

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
  • Dice Id: 91099737
  • Position Id: 4785353SD
  • Posted 8 hours ago
Contact the job poster
KN

Kavya Nair

Recruiter @ QUANTUM TECHNOLOGIES LLC

View Profile
Create job alert
Never miss an opportunity! Create an alert based on the job you applied for.
More jobs at QUANTUM TECHNOLOGIES LLC in Atlanta, GA