Senior Data Engineer - Hybrid

Job Description

The senior data engineer will play a role accomplishing the following team goals: Data Centralization, Data Governance, and Data Integrity. They will lead component design and development, work with data science, development and business analytics teams to design scalable data solutions ensuring quality and performance. They will use their data engineering expertise to enable our company to derive insights, perform analytics, and make decisions on the modern data solutions they will help design, build, and maintain.

Job Responsibilities

Job Duties:

• Design and build large-scale automated and cost-efficient data pipelines that are integrated across multi-platform and disparate data sources using Google Cloud Platform native services (e.g., BigQuery, Dataflow, Dataproc)
• Make key architectural decisions related to data modeling, storage, real-time processing, and orchestration
• Work with multi statement complex queries and enhance performance or able to troubleshoot issues related to performance
• Implement scalable, reusable and efficient data frameworks that ensure data quality, data integrity and performance consistently
• Assist in establishing data governance, quality, and lineage practices using tools like Data Catalog, Data Loss Prevention (DLP), or Cloud Audit Logs
• Creates and maintains intermediate to advanced terraform scripts
• Mentor junior and mid-level engineers, conduct code reviews, and provide technical guidance on best practices
• Translate business requirements into technical design documents and implementation plans
• Participate in support rotation and proactively identify issues while implementing issue resolutions as appropriate
• Monitor and optimize Google Cloud Platform resources to manage costs effectively
• Stay updated with latest Google Cloud Platform services and features
• Evaluate and recommend new tools and technologies to improve data engineering practices

Must Have Skills/Experience

• 6+ years of experience as a data engineer
• Strong experience designing and building automated data pipelines utilizing Google Cloud Platform native services (BigQuery, Dataflow, Dataproc)
• Strong SQL experience
• Python experience

Requirements:

• BS in Information Technology, Computer Science or a related technical field
• 6 – 7 years of experience as a data engineer
• Proficient with Cloud offerings primarily with Google Cloud Platform
• 4 – 5 years minimum experience with relational databases such as MS-SQL, Postgres, or Oracle
• 3 – 4 years of experience with NoSQL databases such as Capella or MongoDB
• 2 – 3 years Python experience or similar