Data Engineer Azure, ETL & Grafana
Issaquah WA
Skills: Digital : Python ~ PostgreSQL ~ Digital : Kubernetes ~ Azure Data Factory
Experience Required: 6-8
The candidate will be solely responsible for building and maintaining the technical foundation of the EQE Observability Portal. This role requires specialized expertise in data engineering, ETL pipeline development, and Grafana implementation.
The EQE Observability Portal will consolidate quality and observability data from multiple systems into a single, intranet-embedded dashboard. The solution will eliminate manual reporting efforts and provide leadership and product teams with real-time visibility into quality metrics and engineering performance.
Key Responsibilities
Design, develop, and maintain ETL pipelines to ingest data from multiple enterprise tools and platforms.
Build and optimize the data warehouse architecture, including schema design and performance tuning.
Deploy and configure Grafana OSS within Azure environments.
Integrate data from REST APIs, including Octane, Azure DevOps (ADO), and SauceLabs.
Configure and manage Azure infrastructure components, including Azure AKS, Azure Active Directory, and Single Sign-On (SSO).
Develop executive and operational dashboards that provide actionable insights and real-time reporting.
Create comprehensive documentation to support ongoing operations, maintenance, and knowledge transfer.
Required Skills
Python development with strong ETL pipeline experience
Azure Data Factory (ADF) and data integration expertise
Azure SQL and PostgreSQL data modeling and database design
Grafana OSS deployment, administration, and dashboard development
REST API integration, including:
o Octane
o Azure DevOps (ADO)
o SauceLabs
Azure Kubernetes Service (AKS)
Azure Active Directory (Azure AD)
Single Sign-On (SSO) configuration and authentication management
Data warehousing and performance optimization
Project Deliverables
1. ETL Pipelines
Develop Python and/or Azure Data Factory (ADF) connectors for all five required tool APIs, enabling automated data ingestion and transformation.
2. Data Warehouse
Design, implement, and optimize the Azure SQL data warehouse schema to support reporting, analytics, and dashboard performance requirements.
3. Grafana Deployment
Deploy Grafana OSS on Azure AKS and configure Azure AD authentication with Single Sign-On (SSO) capabilities.
4. Pilot Dashboards
Develop and deliver three pilot dashboards covering:
Octane
Azure DevOps (ADO)
SauceLabs
These dashboards will provide centralized, real-time quality and observability metrics for stakeholders.
5. Documentation & Knowledge Transfer
Provide complete handoff documentation, including:
Operational runbooks
Data dictionary
Onboarding guide
Configuration and maintenance documentation
Never miss an opportunity! Create an alert based on the job you applied for.
