Overview
Skills
Job Details
Job Title: Lead AI Developer - Azure OpenAI & ML Architect
Location: Remote (U.S. Preferred)
Type: Full-time
Compensation: Competitive salary + Equity options + Performance bonus
About the Company
We are a fast-growing AI platform company focused on building secure, enterprise-grade generative AI tools for industries with strict compliance requirements. Our mission is to enable legal, finance, and operational teams to safely leverage large language models for document creation, summarization, and research-within private, tenant-isolated cloud environments.
We're looking for a Lead AI Developer to join our technical leadership team. This role blends architecture-level responsibility with hands-on development across both Azure and AWS machine learning ecosystems.
Role Overview
You will design, implement, and scale advanced generative AI systems-including retrieval-augmented generation (RAG) pipelines-while working with complex, high-value data in regulated sectors. You'll be the driving force behind our platform's intelligent capabilities, working directly on core infrastructure, semantic search, and secure deployment.
This is a senior technical leadership role requiring both architectural thinking and day-to-day engineering execution.
Key Responsibilities
< data-start="1640" data-end="1674">Architecture & Development</>
Design and deploy scalable AI features using Azure OpenAI, Semantic Kernel, and custom orchestration layers.
Build high-performance RAG pipelines, focusing on chunking strategies, embeddings, and latency optimization.
Architect ingestion workflows and indexing pipelines for long, structured documents.
Leverage tools like QDRANT or similar vector search engines for retrieval across structured and unstructured datasets.
< data-start="2122" data-end="2162">Model Integration & Optimization</>
Integrate LLM APIs with private enterprise datasets, including function-calling and dynamic prompt orchestration.
Tune and evaluate prompts for legal/compliance-heavy use cases.
Adapt pre-trained models for document generation, summarization, and classification tasks.
< data-start="2439" data-end="2473">Leadership & Collaboration</>
Provide architectural guidance and mentor junior/mid-level engineers.
Drive best practices in code quality, security, and delivery of AI features.
Translate complex business requirements into scalable AI-driven solutions.
< data-start="2703" data-end="2741">Security, Privacy & Deployment</>
Ensure secure handling of sensitive data under frameworks like SOC 2, HIPAA, or HITRUST.
Assist with deployment of AI systems in customer-owned Azure environments, including secure, tenant-isolated setups.
Required Skills and Qualifications
5+ years of experience in AI, ML, or NLP development.
Expertise in RAG pipelines: chunking, embedding tuning, vector search (e.g., FAISS, QDRANT, Pinecone).
Advanced .NET development experience, especially with:
Semantic Kernel, LangChain, Transformers
Strong knowledge of Azure AI services, including Azure OpenAI, Azure ML, and cloud security patterns.
Experience with AI deployment using Docker, Kubernetes, and IaC (Terraform or ARM).
Familiarity with real-time or large-batch document ingestion architectures.
Nice to Have
Background in legal tech or document management systems (e.g., iManage, NetDocuments).
Experience building LLM systems for regulated industries (legal, finance, healthcare).
Interest in autonomous agents, tool orchestration (e.g., ReAct, Autogen), and prompt engineering.
Knowledge of AWS ML services (e.g., SageMaker, Lambda, Kendra) is a plus.
Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.