OpenSearch Engineer

Overview

Hybrid
Depends on Experience
Contract - W2
Contract - 12 Month(s)
50% Travel

Skills

Elasticsearch
OpenSearch
Bash
Ansible
Apache Kafka
Dashboard
GitHub
Docker
ETL
AWS
Machine Learning (ML)
Kubernetes
RBAC
Microsoft Azure
JavaScript
Interfaces
Jenkins
Kibana
Tidal
TWS
Python
Stacks Blockchain
Visualization
Microservices
Informatica

Job Details

Job Title: OpenSearch Engineer

Location: Minneapolis, MN (Hybrid)

Contract Type: W2 (NO C2C)

Duration: 12+ Months

Job Summary

We are looking for an experienced OpenSearch Engineer to design, implement, and optimize high-performance OpenSearch clusters for large-scale log analytics, search, and observability. You will ensure scalability, security, and efficiency while integrating OpenSearch with microservices, databases, and cloud platforms.

Key Responsibilities

  • Design, deploy, and maintain scalable OpenSearch clusters across development, staging, and production environments.
  • Optimize indexing, querying, and storage strategies for performance and cost-efficiency.
  • Monitor and troubleshoot cluster health, performance, and availability issues.
  • Implement security best practices (RBAC, encryption, audit logging) for data protection.
  • Integrate OpenSearch with microservices, application logs, metrics, and event streams.
  • Manage data ingestion pipelines using Kafka, AWS Glue, and EMR.
  • Configure OpenSearch Dashboards (Kibana) for log analytics, visualization, and search interfaces.
  • Automate deployments using CI/CD pipelines (Jenkins, GitHub Actions, etc.).
  • Tune search and indexing performance (sharding, replication, caching).
  • Optimize storage strategies (hot-warm-cold architectures, ILM policies).
  • Troubleshoot slow queries, indexing bottlenecks, and JVM issues.
  • Deploy and manage OpenSearch on cloud platforms (AWS, Google Cloud Platform, Azure).
  • Work with containerized environments (Docker, Kubernetes).
  • Implement Infrastructure as Code (IaC) using Terraform, Ansible, or CloudFormation.

Required Skills & Qualifications

  • 10+ years of experience managing Elasticsearch/OpenSearch clusters in production.
  • Strong expertise in:
    • OpenSearch/Elasticsearch internals (indexing, sharding, query optimization).
    • Data ingestion pipelines (Kafka, AWS Glue, EMR).
    • Scripting & automation (Bash, Python, JavaScript).
  • Hands-on with cloud platforms (AWS, Google Cloud Platform, Azure).
  • Experience with containerization (Docker, Kubernetes).
  • Knowledge of observability & logging stacks (Fluentd, Logstash, Beats).
  • Strong problem-solving & debugging skills.
  • Excellent communication & collaboration skills.

Preferred Qualifications

  • Experience with ETL tools (Informatica, AWS Glue).
  • Scheduling tools (TWS, TIDAL).
  • OpenSearch plugins & extensions.
  • Machine learning for log anomaly detection.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.