Agentic Data Engineer

Overview

Hybrid
Depends on Experience
Contract - W2

Skills

BigD_DataScience
DM_Data Architecture

Job Details

Our government client is looking for an Agentic Data Engineer on a hybrid 6+ months renewable contract role in Richmond, VA

Position – Agentic Data Engineer

Job Description:
Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems.
The agency's Information Technology Division is seeking a highly skilled Agentic Data Engineer to design, develop, and deploy data pipelines that leverage agentic AI that solve real-world problems. The ideal candidate will have experience in designing data process to support agentic systems, ensure data quality and facilitating interaction between agents and data. 

Responsibilities

  • Designing and developing data pipelines for agentic systems, develop Robust data flows to handle complex interactions between AI agents and Data sources. 
  • Ability to train and fine tune large language models 
  • Design and build the data architecture, including databases, data lakes to support various data engineering tasks. 
  • Develop and manage Extract, Load, transform (ELT) processes to ensure data is accurately and efficiently moved from source systems to analytical platforms used in data science. 
  • Implement data pipelines that facilitate feedback loops, allowing human input to improve system performance in human-in-the-loop systems. 
  • Work with vector databases to store and retrieve embeddings efficiently. 
  • Collaborate with data scientists and engineers to preprocess data, train models, and integrate AI into applications. 
  • Optimize data storage and retrieval with high performance 
  • Statistical analysis, trends, patterns to create data formats from multiple sources. 

Qualifications:

  • Strong Data engineering fundamentals 
  • Utilize Big data frameworks like Spark/Databricks 
  • Training LLMs with structed and unstructured data sets. 
  • Understanding of Graph DB 
  • Experience with Azure Blob Storage, Azure Data Lakes, Azure Databricks 
  • Experience implementing Azure Machine Learning, Azure Computer Vision, Azure Video Indexer, Azure OpenAI models, Azure Media Services, Azure AI Search? 
  • Determine effective data partitioning criteria  
  • Utilize data storage system spark to implement partition schemes 
  • Understanding core machine learning concepts and algorithms 
  • Familiarity with Cloud computing skills 
  • Strong programming skills in Python and experience with AI/ML frameworks. 
  • Proficiency in vector databases and embedding models for retrieval tasks. 
  • Expertise in integrating with AI agent frameworks. 
  • Experience with cloud AI services (Azure AI). 
  • Experience with GIS spatial data to create markers on maps ( lat long nearest topology of road, geo-locate between datasets, correlation etc.).  
  • Experience with Department of Transportation Data Domains developing an AI Composite Agentic Solution designed to identify and analyze?data models, connect & correlate?information to validate?hypotheses, forecast, predict and recommend?potential strategies and conduct What-if analysis.   
  • Bachelor's or master's degree in computer science, AI, Data Science, or a related field. 
Required/Desired Experience:
  • 1 year of Understanding the Big data Technologies Required
  • 1 year of Experience developing ETL and ELT pipelines Required
  • 1 year of Experience with Spark, GraphDB, Azure Databricks Required
  • 1 year of Expertise in Data Partitioning Required
  • 3 years of Experience with Data conflation Required
  • 3 years of Experience developing Python Scripts Required
  • 2 years of Experience training LLMs with structured and unstructured data sets Required
  • 3 years of Experience with GIS spatial data Required
About Vector:
Vector Consulting, Inc., (Headquartered in Atlanta) is an IT Talent Acquisition Solutions firm committed to delivering results. Since our founding in 1990, we have been partnering with our customers, understanding their business, and developing solutions with a commitment to quality, reliability and value. Our continuing growth has been and continues to be built around successful relationships that are based on our organization's operating philosophy and commitment to ** People, Partnerships, Purpose and Performance - THE VECTOR WAY

www.vectorconsulting.com
“Celebrating 30 years of service.”

#LI-GK1
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.