Position Tittle: Observability Engineer(Backfill Role)
Location: Malvern, PA
Duration: Long Term
Job Details:
We are seeking an experienced Observability Engineer to support a strategic observability platform migration initiative. This role will be responsible for playing a core part in executing the migration of observability artifacts: SLOs, dashboards, alerts, and monitoring workflows from Honeycomb to Splunk Observability Cloud.
The ideal candidate combines deep technical expertise with strong communication and collaboration skills and has hands-on experience designing, implementing, and operating modern observability solutions using OpenTelemetry, Honeycomb, and Splunk Observability Cloud.
This is a contract position with an anticipated duration of 12 months, beginning as soon as possible.
Key Responsibilities
Assist in the migration of observability assets and telemetry workflows from Honeycomb to Splunk Observability Cloud.
Assess, document, and translate existing dashboards, alerts, SLOs, and other monitoring configurations.
Design and implement observability solutions utilizing OpenTelemetry standards and best practices.
Partner with enterprise engineering, SRE, and platform teams to validate telemetry quality, monitoring coverage, and operational readiness.
Identify opportunities to improve observability maturity, reliability, and operational efficiency during the migration.
Develop documentation, knowledge transfer materials, and migration playbooks.
Communicate progress, risks, dependencies, and recommendations to technical and non-technical stakeholders.
Required Qualifications
Strong technical, analytical, and communication skills.
Experience working in Site Reliability Engineering (SRE), Observability Engineering, Platform Engineering, or a related discipline.
Hands-on experience with Splunk Observability Cloud, including dashboards, detectors, APM, infrastructure monitoring, and related capabilities.
Hands-on experience with Honeycomb, including telemetry analysis, dashboards, and operational workflows.
Experience implementing and supporting OpenTelemetry instrumentation, collection, and telemetry pipelines.
Experience working with distributed systems, cloud-native applications, APIs, and microservices environments.
Ability to collaborate effectively across engineering, operations, and leadership teams.
Experience documenting technical solutions and communicating complex concepts to diverse audiences.
Preferred Qualifications
Experience leading or participating in enterprise-scale observability platform migrations.
Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Familiarity with CI/CD pipelines and automated deployment practices.
Knowledge of modern monitoring, tracing, logging, and metrics best practices.
Experience supporting production environments with high availability and reliability requirements.