Elastic stack ELK

Job Title: Elastic stack ELK

Location: Washington D.C (Remote)

Essential Functions:

• Design and implement end-to-end observability services using ELK stack on AWS .
• Manage the health of ELK.
• Collect Logs, Metrics and APM data and User Experience data from Data sources on AWS.
• Implement index lifecycle management (ILM) using hot-warm-cold-frozen architecture to automate data streams management in a cost-effective manner. Backup data streams, create and manage searchable snapshots.
• Leverage Kibana to create preconfigured, and editable dashboards, processing different sources of data and provide unified view of observability data.
• Use time series modeling to detect anomalies in the current data and forecast trends and configure alerts to notify support teams.
• Implement ingest pipelines for converting, enriching and processing the data as required. Process unstructured data using Elasticsearch ingest nodes and structure the data before indexing it into Elasticsearch.
• Implement Real User Monitoring(RUM) and Synthetic Transaction Monitoring
• Configure to extract new insights from observability data using AI OPs and machine learning features.

Essential Skills:

• Must possess experience in Enterprise Observability platform tools and technologies with mid-expert skill level:
• AWS Cloud Platform (essential AWS services - API gateway, Lambda, ALB, ECS, Cloudformation, IAM)
• Elastic, Logstash & Kibana - (ELK stack)
• AWS Managed Kafka or Confluent Cloud
• AppDynamics or Datadog or Dynatrace or New Relic

Resource needs to have the following Skill set

Observability

Unify app and infrastructure visibility to proactively resolve issues.

• Log Monitoring
• Application performance monitoring
• Infrastructure monitoring
• Synthetic monitoring
• Real user monitoring
• Universal Profiling
• AIOps
• Open Telemetry