The OpenSearch Developer / Data Engineer will design, build, and maintain large-scale data ingestion, transformation, and indexing pipelines to support T-Mobile s observability and analytics ecosystem. The role focuses on migrating critical network telemetry and log data from Splunk to OpenSearch while ensuring high performance, scalability, and data governance. The engineer will collaborate across technical teams to optimize data workflows and deliver actionable insights.
Design and implement ETL processes for complex data ingestion workflows.
Build data pipelines to collect, normalize, and transport high-volume log and telemetry data from multiple systems.
Migrate datasets from Splunk to OpenSearch, ensuring data integrity and consistency.
Optimize ingestion and query performance with indexing, partitioning, and caching strategies.
Configure, manage, and tune OpenSearch clusters for scalability and reliability.
Design indexing strategies and mappings for large-scale network data.
Implement access control, retention policies, and lifecycle management.
Create operational dashboards and analytics visualizations as needed.
Develop Java-based backend services to support data ingestion, query processing, and APIs.
Automate ETL workflows using Python, Perl, or JavaScript.
Develop and maintain Kafka producers/consumers for real-time event streaming.
Write and execute unit, integration, and performance tests for data workflows.
Automate build, test, and deployment through GitLab CI/CD pipelines.
Deploy and monitor services in Linux-based environments.
Troubleshoot ingestion or indexing issues to ensure low latency and high reliability.
Enforce data governance and logging standards to ensure data relevance and value.
Document architecture, APIs, data schemas, and workflows.
Collaborate with architects, developers, and analysts to align OpenSearch initiatives with broader observability goals.
Contribute to knowledge sharing and best practices documentation.
Programming: Java, Python, JavaScript, Perl
Data Engineering: ETL design, transformation, and pipeline management
Search Technologies: OpenSearch or Elasticsearch (indexing, tuning, scaling)
Streaming: Kafka (producers, consumers, schema management)
CI/CD: GitLab pipelines
Operating Systems: Linux (scripting, automation, monitoring)
Migration of large-scale datasets from Splunk to OpenSearch
Managing high-throughput network data ingestion pipelines
Experience with data retention and governance policies
Familiarity with telecom network monitoring and telemetry systems
Strong analytical and problem-solving mindset
Effective communication and documentation abilities
Ability to work independently and collaboratively across global teams
Proven record of delivering under tight deadlines
Complete migration of network data from Splunk to OpenSearch without disruption.
Optimized OpenSearch clusters with faster queries and reduced latency.
Fully automated and reliable ETL pipelines improving operational efficiency.
Effective data governance ensuring valuable, cost-efficient data retention.
Enhanced observability supporting proactive monitoring and rapid issue resolution.
ETL and data pipeline architecture and scalability
OpenSearch or Elasticsearch administration and tuning
Java/Python coding assessment
Kafka integration and troubleshooting scenarios
Data governance and migration strategy discussion