Job title: Splunk Observability & APM Integration Specialist
Location : Warren, NJ - 3 days a week on-site is a must
Contract : 6 month assignment with the option to extend. Full-time is possible in the future as well.
Rate : Open and will be commensurate with experience.
Must have the following: Advanced Splunk administration, expert SPL, OpenTelemetry, APM and distributed tracing, Splunk APM/SignalFx, Dynatrace, synthetic monitoring, shell scripting, PowerShell, LogicMonitor, AutoSys, enterprise observability, logs, metrics, traces, SLOs, alerting, and dashboard development.
We're looking for a senior hands-on Observability Architect/Engineer who has actually designed and built enterprise monitoring platforms using Splunk/OTel/APM/Cribl, can integrate logs, metrics, and traces across Windows, Linux, and AIX, build alerting and synthetic monitoring, automate onboarding, and personally troubleshoot the platform in production.
Responsibilities:
Our client is seeking a hands-on Splunk Observability & APM Integration Specialist to help build an enterprise monitoring and observability framework from the ground up. This contract-to-hire consultant will establish Splunk as the central analytics and dashboarding platform while integrating existing monitoring tools, application telemetry, infrastructure data, batch pipelines, and messaging platforms.
- Build Splunk dashboards, correlation searches, and SPL-based operational views that support a single-pane monitoring model.
- Integrate LogicMonitor, AutoSys, OpenTelemetry, and custom data collectors into Splunk.
- Establish practical APM capabilities, including distributed tracing using an OpenTelemetry-first approach.
- Assess and advise on buy-versus-build decisions across Splunk APM/SignalFx and Dynatrace.
- Design synthetic monitoring for critical user journeys, including SLOs, alerting, escalation workflows, and PagerDuty routing.
- Develop automation using shell scripting and PowerShell across Windows and Linux environments.
- Assess applications to identify meaningful logging, metric, and tracing opportunities.
- Build tactical dashboards for immediate operational visibility and strategic dashboards for long-term support and incident response needs.
- Create architecture documentation, implementation patterns, operational runbooks, and knowledge-transfer materials.
- Develop telemetry solutions for legacy, custom, unconventional, or unsupported platforms.
- Partner with technical and operational stakeholders to deliver measurable monitoring outcomes.
Requirements:
- Advanced Splunk administration experience with expert-level SPL skills.
- Strong background in log observability, operational monitoring design, and enterprise dashboard development.
- Hands-on APM, application instrumentation, and distributed tracing experience.
- Strong knowledge of OpenTelemetry, including Collector, OTLP, telemetry pipelines, and instrumentation patterns.
- Experience with Splunk APM/SignalFx and Dynatrace, including synthetic monitoring capabilities.
- Strong shell scripting and PowerShell automation skills.
- Experience with LogicMonitor and AutoSys, or comparable monitoring and workload automation platforms.
- Solid understanding of logs, metrics, traces, SLOs, alerting, incident response, and modern observability practices.
- Ability to instrument difficult-to-monitor platforms and normalize telemetry into a unified observability framework.
- Strong application assessment skills, including identifying logging opportunities and translating findings into dashboards and monitoring strategies.
- Clear verbal and written communication skills with a collaborative approach to documentation and knowledge transfer.
- Ability to work effectively with engineering, infrastructure, operations, and support stakeholders.
- Experience with PagerDuty, fintech platforms, regulated environments, or enterprise incident-response dashboards is preferred.
Never miss an opportunity! Create an alert based on the job you applied for.
