Lead Data Engineer Google Cloud Platform & OCI
Cloud Destinations LLC
Dice Job Match Score™
📊 Calculating match score...
Job Details
Skills
- GCP and Oracle Cloud Infrastructure(OCI)
- low latency
- Team Lead
Summary
- Architect, implement, and maintain scalable data lakes, lakehouses, and data warehousing strategies across Google Cloud Platform and OCI.
- Design resilient and low latency Extract, Transform, Load and Extract, Load, Transform pipelines to ingest, clean, and transform data from diverse transactional, operational, and business systems.
- Lead, mentor, and support a team of data engineers, analytics engineers, and database developers.
- Establish code quality standards and conduct architecture reviews to support reliable and scalable data solutions.
- Partner with application, Data Science, merchandising, and supply chain technology teams to ensure the data platform delivers clean, timely, and actionable insights.
- Support pipeline orchestration and platform operations for enterprise data environments.
- Implement automated data testing, anomaly detection, and data lineage tracking to support trust in enterprise reporting.
- Optimize database, warehouse, and query performance, including approaches such as BigQuery partitioning, BigQuery clustering, and OCI Autonomous Data Warehouse indexing.
- Enforce data governance, access control policies, row and column level security, and cataloging practices to support audits and data discovery.
- Monitor and optimize storage and compute costs associated with large scale query activity, including BigQuery slots, Serverless Dataproc, OCI Compute, and storage layers.
- Eight or more years of experience in data engineering, data warehousing, or software engineering.
- Three or more years of experience leading engineering teams.
- Strong hands on experience with Google Cloud Platform data and analytics services, including BigQuery, Dataproc, cloud functions, cloud runners, Cloud Storage, and Pub and Sub.
- Experience with OCI data infrastructure, including Autonomous Data Warehouse, OCI GoldenGate, Oracle Integration Cloud, and Oracle Database Cloud Services.
- Advanced SQL and Python experience for building robust data extraction and transformation logic.
- Experience with CI/CD pipelines, including GitLab CI.
- Experience supporting business intelligence, analytics, or data science use cases.
- Strong communication and collaboration skills with the ability to work across technical and business teams.
- Google Cloud Platform
- Oracle Cloud Infrastructure
- BigQuery
- Dataproc
- Cloud Functions
- Cloud Storage
- Pub and Sub
- OCI Autonomous Data Warehouse
- OCI GoldenGate
- Oracle Integration Cloud
- Oracle Database Cloud Services
- SQL
- Python
- GitLab CI
- Google Cloud Platform Vertex AI
- Data lakes
- Lakehouses
- Data warehouses
- Data lineage tools and practices
- Data quality and observability practices
- Dice Id: 91097117
- Position Id: 9053267
- Posted 15 hours ago
Company Info
One of the leading US-based staffing and IT consulting partner. Experience exceptional service and top-tier talent across industries. Count on us for staffing solutions that cater to the unique demands of the American market.
Our experienced recruiters ensure a seamless fit within your team, accelerating success. But we go beyond staffing and empower employees with fully sponsored certification programs, keeping them ahead. Experience comprehensive benefits including health, wellness coverage, dental insurance, vision insurance, as well as flexible hours, remote work options, and a robust 401K plan to ensure a secure future at the companies we represent.
At Cloud Destinations, we bring industry expertise and a passion for excellence. From Enterprise Cloud Strategy to Managed Infrastructure Services, Digital Transformation, BI & Data Analytics, Security, Data Engineering, and more, we navigate the IT landscape with finesse. Choose us as your trusted partner, witness transformative talent and exceptional service. Let's unlock new possibilities and drive your success in the dynamic world of IT together.
Never miss an opportunity! Create an alert based on the job you applied for.Similar Jobs
It looks like there aren't any Similar Jobs for this job yet.
Search all similar jobs