Data Operations Engineer / DataOps Specialist (AI + LLM)

Role: Data Operations Engineer / DataOps Specialist

Skills: Digital : Python

Experience Required: 10+ years





Primary Skill: LangChain, LangGraph, VectorDB, Python, LLM's



Secondary skill: Pl-SQL with ETL tools

Big Data tools (Spark, Hadoop)

Cloud Platforms (AWS / Azure / Google Cloud Platform)

Data Modeling & Data Architecture

APIs & Data Integration

CI/CD & Automation tools



DataOps Core Skills

Pipeline orchestration & automation

Data quality frameworks

Monitoring & observability (logs, alerts)

Data governance & lineage

Batch & real-time processing



Analytics & BI

Tableau / Power BI

Data visualization & reporting

KPI and dashboard development





Role Descriptions:



1. Data Pipeline & Operations



Build, manage, and monitor ETL/ELT pipelines for data ingestion and transformation Ensure smooth data flow across systems, warehouses, and applications

Automate workflows and reduce manual data handling



2. Data Quality & Governance



Implement data validation, cleansing, and reconciliation processes

Maintain data integrity, consistency, and accuracy across systems.

Define and enforce data governance standards and policies



3. Monitoring & Issue Resolution



Monitor pipelines and data systems for failures and anomalies

Perform root cause analysis and corrective actions

Ensure SLA adherence for data availability



4. Infrastructure & Performance Optimization



Manage data platforms (AWS/Azure/Google Cloud Platform, Data Lakes, Warehouses)

Optimize performance, scalability, and cost efficiency

Support CI/CD for data systems (DataOps practices)