Position: Lead Google Cloud Platform Data Engineer
Location: Irving, Texas or Charlotte NC
Duration: Contract
Job ID: 174279
Only W2
Onsite Interview Job Overview: In this contingent resource assignment, you will consult on complex initiatives with broad impact and large-scale planning for Software Engineering. You will review and analyze multi-faceted, larger-scale, or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented factors. Additionally, you will contribute to the resolution of complex situations requiring a solid understanding of functional policies, procedures, and compliance requirements to meet deliverables. Strategic collaboration and consultation with client personnel will also be a key aspect of this role.
Responsibilities: - Design and develop ETL/ELT workflows and data pipelines for batch and real-time processing.
- Build and maintain data pipelines for reporting and downstream applications using open-source frameworks and cloud technologies.
- Implement operational and analytical data stores leveraging Delta Lake and modern database concepts.
- Optimize data structures for performance and scalability across large datasets.
- Collaborate with architects and engineering teams to ensure alignment with target-state architecture.
- Apply best practices for data governance, lineage tracking, and metadata management, including integration with Google Dataplex for centralized governance and data quality enforcement.
- Develop, schedule, and orchestrate complex workflows using Apache Airflow, with strong proficiency in designing and managing Airflow DAGs.
- Troubleshoot and resolve issues in data pipelines to ensure high availability and reliability.
Qualifications: - 5 years of Software Engineering experience or equivalent, demonstrated through work, consulting experience, training, military experience, or education.
- Strong understanding of data structures, modeling, and lifecycle management.
- Hands-on experience designing and managing ETL/ELT data pipelines.
- Advanced skills in distributed data processing and transformation using PySpark.
- Experience implementing open table formats for analytics, such as NetApp Iceberg.
- Knowledge of the Hadoop ecosystem, including HDFS and Hive.
- Experience with cloud platforms such as Google Cloud Platform (BigQuery, Dataflow), Delta Lake, and Dataplex for governance and metadata management.
- Proficiency in programming languages such as Python, Spark, and SQL.
- Strong experience with Apache Airflow, including authoring and maintaining DAGs for complex workflows.
- Strong understanding of relational and distributed database systems.
About PTR Global: PTR Global is a leading provider of information technology and workforce solutions. PTR Global has become one of the largest providers in its industry, with over 5000 professionals providing services across the U.S. and Canada. For more information visit ;br>
At PTR Global, we understand the importance of your privacy and security. We NEVER ASK job applicants to:
- Pay any fee to be considered for, submitted to, or selected for any opportunity.
- Purchase any product, service, or gift cards from us or for us as part of an application, interview, or selection process.
- Provide sensitive financial information such as credit card numbers or banking information. Successfully placed or hired candidates would only be asked for banking details after accepting an offer from us during our official onboarding processes as part of payroll setup.
Pay Range: $70- $76
The specific compensation for this position will be determined by several factors, including the scope, complexity, and location of the role, as well as the cost of labor in the market; the skills, education, training, credentials, and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits, including medical, dental, vision, and 401K contributions, as well as PTO, sick leave, and other benefits mandated by applicable state or localities where you reside or work.
If you receive a suspicious message, email, or phone call claiming to be from PTR Global do not respond or click on any links. Instead, contact us directly at +1 . To report any concerns, please email us at