Overview
Remote
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 12 Month(s)
Skills
ELK Stack
Elastic
Logstash
Kibana
Kafka
ECS
API gateway
Cloud formation
Lambda
Job Details
Position: ELK Engineer
Location: Remote
Duration: Long Term
Job Description:
Essential Functions:
- Design and implement end-to-end observability services using ELK stack on AWS .
- Manage the health of ELK.
- Collect Logs, Metrics and APM data and User Experience data from Data sources on AWS.
- Implement index lifecycle management (ILM) using hot-warm-cold-frozen architecture to automate data streams management in a cost-effective manner. Backup data streams, create and manage searchable snapshots.
- Leverage Kibana to create preconfigured, and editable dashboards, processing different sources of data and provide unified view of observability data.
- Use time series modeling to detect anomalies in the current data and forecast trends and configure alerts to notify support teams.
- Implement ingest pipelines for converting, enriching and processing the data as required. Process unstructured data using Elasticsearch ingest nodes and structure the data before indexing it into Elasticsearch.
- Implement Real User Monitoring(RUM) and Synthetic Transaction Monitoring
- Configure to extract new insights from observability data using AI OPs and machine learning features.
Essential Skills:
- Must possess experience in Enterprise Observability platform tools and technologies with mid-expert skill level:
- AWS Cloud Platform (essential AWS services - API gateway, Lambda, ALB, ECS, Cloudformation, IAM)
- Elastic, Logstash & Kibana - (ELK stack)
- AWS Managed Kafka or Confluent Cloud
- AppDynamics or Datadog or Dynatrace or New Relic