AI Reliability Engineering

Job Description:

A strong knowledge and experience of deploying AI models to achieve business goals. Experience with ETL Data engineering, Designing and building data pipelines for LLM models Must be good in Python, SQL, Postgress Must be experienced in solution architecture and implementation of data intensive solutions Experience in Data Ingestion and integration from various sources and experience building automated ingestion pipelines using AWS Experience in Data cleaning, processing and transformation for unstructured and semi-structured data Experience preparing data for AI usage and experience with dataprofiling/quality identify data gaps and inconsistencies.

Tools - Strong Python, ETL libraries, SQLs, Docker/Kubernetes, Experience with some AWS Data/Pipeline Services, experience in NLP processing, experience with vector DB Strong Understanding of NLP processing - parsing, chunking, splitting, and tokenization Strong understanding of vector databases and embedding Good experience working with a graph database>

Key Responsibilities*

< - Build and manage ETL and data ingestion pipelines for AI/LLM use cases - Clean, transform and profile data to ensure AI-ready quality - Implement NLP preprocessing and embedding pipelines with vector databases - Design scalable data architectures for data-intensive systems - Enable automated data workflows on AWS in collaboration with teams >

Cygnus Professionals is an Equal Opportunity Employer. We encourage professionals from all backgrounds to apply.