AI/Machine Learning Engineer

Job Description - AI/Machine Learning Engineer Location: Austin, TX 78744 (Onsite) (Need local Candidate - Must Have LinkedIn) Must pass a Criminal Justice Information Systems (CJIS) background check upon hire. (Also, please do not send candidates that live outside of Austin or have not worked in Austin.)

Position Overview:
We are seeking a highly skilled AI Engineer II to design, develop, and deploy
advanced Generative AI solutions within ITD. This onsite role in Austin, TX and
the ideal candidate is a hands-on technologist with experience building
end-to-end AI applications using LLMs, RAG architecture, Azure AI services, or
AWS Bedrock. This role requires strong technical depth in AI model integration,
optimization, and evaluation, as well as a commitment to building secure,
cost-effective, and responsible AI systems. Key Responsibilities

• Develop custom Generative AI
  

applications leveraging LLMs and modern AI frameworks.

• Design and implement RAG
  

(Retrieval-Augmented Generation) pipelines using vector databases,
embedding models, and search solutions to improve contextual accuracy and
relevance.

• Set up sandbox and
  

proof-of-concept environments to experiment with new AI tools, frameworks,
and services.

• Evaluate, benchmark, and
  

fine-tune foundation models for performance, safety, and reliability using
both quantitative and qualitative methods.

• Ensure secure, compliant,
  

and responsible AI implementations, including data obfuscation, content
filtering, and ethical guardrails.

• Monitor and optimize AI
  

models through prompt engineering, error analysis, and continuous feedback
loops.

• Collaborate with
  

cross-functional teams to align AI solutions with business needs and
provide technical expertise on architecture and design.

• Contribute to the
  

organization s AI strategy, staying current with industry trends and
emerging technologies.

Required Skills & Qualifications

• 4 7 years of experience
  

designing and delivering AI-driven applications.

• Hands-on expertise with RAG
  

solutions, including vector databases, embedding models, scripting, and
LLM integration.

• Strong ability to design and
  

implement innovative AI architectures.

• Proven experience evaluating
  

and benchmarking generative models for accuracy, cost, and safety.

• Experience with model
  

monitoring, optimization, and fine-tuning.

• Knowledge of ethical AI practices,
  

including bias detection, guardrails, and responsible deployment
strategies.

Preferred Skills & Qualifications

• 1+ year evaluating LLMs and
  

providers, including SaaS/PaaS access models, cost optimization, and
secure data interaction strategies.

• 1+ year designing AI
  

architectures and services.

• Experience developing or
  

maintaining AI Agents.

• Hands-on experience with
  

Azure AI Foundry or AWS Bedrock.

• Familiarity with Microsoft
  

Copilot integration (a plus).

Candidate Requirements

• Must be local to Austin,
  

TX.

• Must be able to
  

work onsite, Monday Friday

• Must pass a Criminal Justice
  

Information Systems (CJIS) background check upon hire.