Overview
On Site
$120,000 - $140,000
Full Time
Skills
GCP
GCP PubSub
Job Details
Hello,
Job Title Google Cloud Platform Data Engineer
Location Lisle, IL or Columbia, MD (4 Days in Office)
Duration Full Time
Salary - $140K/Annum + Benefits.
Responsibilities
- Work closely with various business, IT, Analyst and Data Science groups to collect business requirements.
- Design, develop, deploy and support high performance data pipelines both inbound and outbound.
- Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
- Optimize data pipelines for performance, scalability, and reliability.
- Implement CI/CD pipelines to ensure continuous deployment and delivery of our data products.
- Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
- Document the design and support strategy of the data pipelines
- Capture, store and socialize data lineage and operational metadata
- Troubleshoot and resolve data engineering issues as they arise.
- Develop REST APIs to expose data to other teams within the company.
- Mentor and guide junior data engineers.
Work Experience
- 6+ years of experience in data engineering solutions such as data platforms, ingestion, data management, or publication/analytics
- 2+ years of experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows
Knowledge, Skills and Abilities
- Expert knowledge on SQL and Python programming
- Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
- Experience in tuning queries for performance and scalability
- Experience in Real Time Data ingestion using Google Cloud Platform PubSub, Kafka, Spark or similar.
- Have proven experience working in incremental execution through successful launches.
- Experience working in agile environment.
Please share your resume to
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.