Dashboard Monitoring Engineer (Grafana and Moogsoft)

Pay Range: $50 - $55/hr. The pay rate may differ depending on your skills, education, experience, and other qualifications.

Featured Benefits:

• Medical Insurance in compliance with the ACA.
• 401(k).
• Sick leave in compliance with applicable state, federal, and local laws.

Job Description:

Key Responsibilities of Grafana:

• Build and maintain a unified Grafana dashboard for monitoring both on-premises and cloud infrastructure.
• Integrate multiple data sources using mixed queries.
• Use templating variables and regex filtering to switch between systems and refine data views.
• Develop workarounds for limited plugin support in legacy systems to ensure complete data visibility.
• Troubleshoot issues using Grafana Explore; validate data source connections and ensure time zone consistency.
• Manage API limitations, including rate limits and paginated responses, to ensure reliable data ingestion.
• Use SQL queries or REST APIs to gather incident data and integrate it into dashboards.
• Resolve mapping issues by linking incidents to systems with inconsistent naming conventions.
• Leverage annotations with dynamic tags to highlight the performance impact of incidents.
• Troubleshoot and optimize Grafana queries for large datasets to minimize performance impact.

Key Responsibilities of Moogsoft:

• Set up and manage secure authentication methods, including Basic Auth, OAuth, and token-based authentication, to ensure secure system integration.
• Design and implement bi-directional synchronization between observability tools and Moogsoft Situations to maintain real-time data consistency.
• Configure correlation logic in Moogsoft by defining correlation keys and rules to accurately match incidents with events, reducing duplication and improving synchronization.
• Implement automated incident creation workflows based on alerts from observability tools, ensuring proper generation and assignment based on severity and impacted services.
• Establish processes for incident updates, define change triggers, and ensure incidents remain aligned with the latest observability insights.
• Fine-tune Moogsoft s AIOps capabilities to enhance noise reduction, minimize false positives, and support accurate root cause analysis.

Preferred Qualifications:

• Familiarity with SRE principles (SLIs, SLOs, SLAs).
• Experience with cloud platforms (AWS, Google Cloud Platform) and cloud-native observability tools.
• Proficiency in Infrastructure-as-Code (e.g., Terraform) or configuration management tools.
• Experience as an integration specialist, including configuring scripted REST APIs, customizing JSON payloads, and managing integrations using JSON, XML, and JavaScript.
• Expertise with monitoring tools (e.g., SolarWinds, Nagios, Dynatrace) and log aggregators (e.g., ELK, Splunk, SentinelOne).
• Strong experience with ServiceNow ITSM, including Business Rules, Scripted REST APIs, and Web Services.
• Proficiency in scripting languages such as JavaScript, Python, or Groovy.