Google Cloud Platform Lead Data Engineer - Concord, NC- (12+Years of Exp needed)

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - Independent
Contract - W2
Contract - 12 month(s)
No Travel Required

Skills

Python
data engineer
ETL
Kafka
GCP
Lead
BigQuery
DataFlow
Pub/Sub
DataFusion

Job Details

Role Name: Google Cloud Platform Lead Data Engineer
Location: Concord, NC (Onsite)

Duration:12 Months +


Key Responsibilities:
Design, develop, and deploy cloud-based solutions using Google Cloud Platform services such as DataFlow, DataFusion, Dataproc, Composer, GCS, BigQuery, and more.
Build and maintain robust, scalable, and efficient Python applications and scripts that integrate with Google Cloud Platform.
Collaborate with cross-functional teams, including product owners, architects, scrum masters and other stakeholders, to define project requirements, timelines, and deliverables.
Ensure the development adheres to best practices in coding standards, code reviews, and continuous integration/continuous deployment (CI/CD).
Implement and maintain security best practices across all cloud-based solutions to ensure data integrity and compliance with industry standards.
Stay updated with the latest trends and technologies in cloud computing and Python development, and drive the adoption of new tools and techniques that enhance productivity and efficiency.

Required Skills and Qualifications:
Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
8+ years of experience in software development with a focus on ETL, Python and cloud technologies, with at least 2 years in a senior/lead developer role.
Extensive hands-on experience with Google Cloud Platform, including services like DataFlow, DataFusion, Dataproc, Composer, GCS, BigQuery, and Pub/Sub.
Advanced proficiency in Python programming and Messaging platforms like Kafka
Strong understanding and experience in both batch and streaming ETLs pipelines
Strong knowledge of CI/CD pipelines and tools such as Jenkins, GitHub, UCD, Harness or similar.
Proficient in Git and branching strategies.
Excellent communication and collaboration skills, with the ability to articulate technical concepts to non-technical stakeholders.
Strong understanding of data systems architecture and data pipelines
Knowledge and Experience in Unix shell scripting

Preferred Skills:
Exposure to software development methodologies such as Agile or Scrum.
Experience and knowledge on orchestration tools such as Airflow, Autosys, SQL Agent etc.,
Relevant Google Cloud Platform certifications such as Associate/Professional Cloud Architect or Associate/Professional Data Engineer are highly desirable.
Understanding of SQL Server and SSIS packages a plus

Best Regards,

Chetna

-D

-Fax

Truth Lies in Heart

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.