Overview
Skills
Job Details
Job Title: Lead Google Cloud Platform Data Engineer
Location: Atlanta, GA (Locals only)
Key Responsibilities
Lead the design and implementation of data ingestion, transformation, and processing pipelines.
Develop and operate scalable distributed data systems using Google Cloud Platform tools such as DataProc, Dataflow, BigQuery, Cloud Spanner, Cloud SQL, Pub/Sub, and Cloud Storage.
Strong programming skills in languages such as Python, Java, Scala, and proficiency with SQL.
Build solutions to support batch and streaming data workflows, including API interfaces.
Guide and mentor data engineers, establish best practices, and ensure high-quality code and system performance.
Enable data quality, governance, and compliance with industry standards.
Troubleshoot and optimize data pipelines and infrastructure for performance and reliability.
Collaborate with data scientists, analysts, and business teams to understand and fulfill their data needs.
Implement logging, monitoring, and alerting for data jobs and infrastructure.
Drive the adoption of Infrastructure as Code (IaC) practices using tools like Terraform.
Solid understanding of data architecture, ETL/ELT processes, data warehousing, and metadata management.
Strong problem-solving, communication, and team leadership skills.