Senior Observability Data Engineer

Overview

Remote
$60
Full Time

Skills

OTEL
Databricks
Spark
AWS
Azure
GCP
SQL
Python
Cribl

Job Details

Key Responsibilities:

  • Build and scale enterprise-grade telemetry pipelines (logs, metrics, traces).
  • Develop ingestion & transformation workflows (Cribl, Vector, Jenkins, GitHub Actions).
  • Architect Observability Lakehouse aligned with OTEL data models.
  • Build ETL/ELT frameworks, Delta Lake processes, and data quality checks.
  • Collaborate with Security, SRE, Cloud, and SOC teams.
  • Develop CI/CD workflows and IaC patterns (Terraform, etc.).
  • Troubleshoot pipeline performance and optimize for reliability and cost.

Required Skills:

  • 5+ years in OTEL-aligned telemetry/log/metric/trace pipelines.
  • 5+ years with Databricks/Spark or distributed data systems.
  • 5+ years with cloud platforms (AWS/Azure/Google Cloud Platform).
  • Strong SQL & Python experience in production environments.

Best Regards,

Hari Daile

Senior US IT Recruiter

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.