AI Data Engineer

Software Guidance & Assistance, Inc., (SGA), is searching for an AI Data Engineer for a CONTRACT assignment with one of our premier Insurance Services clients. This role is hybrid out of Hartford, CT or Charlotte, NC, or fully remote.

Responsibilities :

• Design, develop, and implement complex data pipelines for AI/ML, including those supporting RAG architectures, using technologies such as Python, Snowflake, AWS, Google Cloud Platform, and Vertex AI.
• Implement on end-to-end generative AI pipelines, from data ingestion to pipeline deployment and monitoring.
• Build and maintain data pipelines that ingest, transform, and load data from various sources (structured, unstructured, and semi-structured) into data warehouses, data lakes, vector databases (e.g., Pinecone, Weaviate, Faiss - consider specifying which ones you use or are exploring), and graph databases (e.g., Neo4j, Amazon Neptune - same consideration as above).
• Develop and implement data quality checks, validation processes, and monitoring solutions to ensure data accuracy, consistency, and reliability.
• Implement end-to-end generative AI data pipelines, from data ingestion to pipeline deployment and monitoring.
• Develop complex AI systems, adhering to best practices in software engineering and AI development.
• Work with cross-functional teams to integrate AI solutions into existing products and services.
• Keep up-to-date with AI advancements and apply new technologies and methodologies to our systems.
• Assist in mentoring junior AI/data engineers in AI development best practices.
• Implement and optimize RAG architectures and pipelines.
• Develop solutions for handling unstructured data in AI pipelines.
• Implement agentic workflows for autonomous AI systems.
• Develop graph database solutions for complex data relationships in AI systems.
• Integrate AI pipelines with Snowflake data warehouse for efficient data processing and storage.
• Apply GenAI solutions to insurance-specific use cases and challenges.

Required Skills :

• Bachelor's in Computer Science, Artificial Intelligence, or a related field.
• 6+ years of experience in data engineering
• Awareness of data engineering, with at least some hands on with generative AI technologies.
• Ability to showcase implementation of production-ready enterprise-grade GenAI pipelines.
• Experience & awareness of prompt engineering techniques for large language models.
• Experience & awareness in implementing Retrieval-Augmented Generation (RAG) pipelines, integrating retrieval mechanisms with language models.
• Knowledge of vector databases and graph databases, including implementation and optimization.
• Experience & awareness in processing and leveraging unstructured data for GenAI applications.
• Proficiency in implementing agentic workflows for AI systems.

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.