SDM / DataOps Engineer GS-TRP Integration

We are seeking a highly experienced DataOps Engineer / SDM (Software Development Manager) with strong DevOps and AWS data engineering expertise to support GS-TRP integration initiatives. The ideal candidate will drive automation, CI/CD enablement, cloud-native data infrastructure, and operational excellence across data platforms.

This role requires hands-on experience with AWS data services, Kubernetes-based deployments, strong SQL capabilities, and a solid understanding of data analytics workflows.

Key Responsibilities

DevOps & Automation

• Design, implement, and maintain CI/CD pipelines for data and application deployments.
• Automate infrastructure provisioning and deployment processes.
• Manage build, release, and environment promotion strategies (Dev QA Prod).
• Monitor and optimize deployment reliability and performance.

AWS Data Services

• Work extensively with AWS data services such as:
  • AWS S3
  • AWS Glue
  • AWS Lambda
  • AWS RDS / Redshift
  • AWS EMR
  • CloudWatch
• Support scalable, secure, and high-performance cloud data solutions.
• Ensure cost optimization and performance tuning of AWS resources.

Kubernetes & Containerization

• Deploy and manage containerized workloads using Kubernetes.
• Handle pod management, scaling, service mesh, and cluster monitoring.
• Implement container orchestration best practices.

SQL & Data Analytics

• Write and optimize complex SQL queries.
• Support analytical workloads and data validation processes.
• Collaborate with analytics teams for performance tuning and troubleshooting.
• Ensure data integrity and pipeline reliability.

DataOps Best Practices

• Implement DataOps frameworks for data pipeline automation.
• Enable monitoring, observability, logging, and alerting mechanisms.
• Improve data release velocity and reduce operational bottlenecks.

Communication & Collaboration

• Work closely with data engineers, analysts, DevOps teams, and business stakeholders.
• Translate technical concepts into business-friendly language.
• Provide status updates and proactively resolve integration issues.

Mandatory Skills

• 10+ years of strong DevOps experience
• Hands-on experience with AWS Data Services
• Strong Kubernetes experience
• Strong SQL expertise
• Experience in data analytics environments
• Excellent communication skills

Preferred Skills

• Experience with DataOps frameworks
• Infrastructure as Code (Terraform/CloudFormation)
• CI/CD tools (Jenkins, GitHub Actions, GitLab)
• Monitoring tools (Prometheus, Grafana, ELK, Datadog)
• Experience in financial or enterprise integration programs