Apply Now

Software Engineer I - Inference

Fort Meade, MD, US • Posted 3 days ago • Updated 4 hours ago

Full Time

On-site

USD $124,000.00 - 181,000.00 per year

Fitment

Dice Job Match Score™

🔢 Crunching numbers...

Job Details

Skills

FOCUS
Large Language Models (LLMs)
Proprietary Software
Computer Science
Software Engineering
Python
Programming Languages
Continuous Integration
Continuous Delivery
Kubernetes
Amazon Web Services
Cloud Computing
Emerging Technologies
Collaboration
Reliability Engineering
Grafana
Management
Docker
QoS
Hosting
Artificial Intelligence

Summary

Job Description

SALARY RANGE $124,000 - $181,000/year.

DUTIES As a successful candidate for the Software Engineer I - Inference role, you will join our AI infrastructure team to build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications. Your primary focus will be ensuring seamless access to the highest quality large language models (LLMs) throughout the inference software stack. Operating in a dynamic environment where requirements shift as mission needs evolve and new technologies emerge, you will continuously sharpen your skills and turn loosely defined problems into impactful, working solutions.

Required Skills

SKILLS

Procure, configure, and test new inference models to prepare them for seamless release to the user base
Develop in-house services and techniques to guarantee continuous, high-quality inference performance
Partner with model vendor teams to establish reliable integration pipelines for closed-source models
Collaborate with teammates on surge efforts to address high-priority, short-term customer inference demands
Engage with cross-functional teams to build resilient service infrastructure and integrate LLM-powered tools for end-user needs

QUALIFICATIONS Three (3) years' experience as a SWE in programs and contracts of similar scope, type, and complexity is required. A Bachelor's degree in Computer Science or a related discipline from an accredited college or university is required. Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor's degree.

Additional Requirements:

Develop with Python and other modern programming languages
Utilize Argo CD or other modern CI/CD frameworks
Deploy and manage containerized applications using Kubernetes and Helm
Operate within AWS or other major cloud service provider environments
Demonstrate a proven ability to rapidly learn and adopt emerging technologies
Communicate clearly and collaborate proactively to address technical and mission needs

Desired Skills

NICE-TO-HAVES

Leverage vLLM, LiteLLM, or similar inference-serving frameworks
Apply modern LLM hosting frameworks and deployment practices
Support production software using Site Reliability Engineering (SRE) best practices
Utilize Elastic, Grafana, Prometheus, or other observability frameworks
Package and manage applications using Docker and containerization
Implement traffic shaping and quality-of-service engineering strategies
Demonstrate strong interest and foundational knowledge in hosting AI capabilities

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id: 91130336
Position Id: 5fe13293ec4b429469b15b88e0a2c867
Posted 3 days ago

Create job alert

Never miss an opportunity! Create an alert based on the job you applied for.

Similar Jobs

Junior Software Engineer

Fort Meade, Maryland

•

Today

Belay Technologies has been voted Baltimore Business Journal's (BBJ) Best Places to Work 2019, runner up in 2020 and a finalist in 2021! Belay Technologies is seeking a Software Engineer to join our intel team. Join us in building the next generation of AI infrastructure that will power innovation across the customer organization. We're seeking a software engineer to support our AI infrastructure team. In this role, you'll help build and maintain the foundation for customer AI capabilities while

Full-time

USD 70,000.00 per year

Software Engineer I - Platform

Fort Meade, Maryland

•

Today

Job Description SALARY RANGE $124,000 - $181,000/year DUTIES As a successful candidate for the Software Engineer I - Platform role, you will support the Platform Team, which owns the AWS infrastructure, Kubernetes clusters, and security posture that every AI capability in the organization runs on. In this role, you'll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications. Your focus will be deploying and maintaining

Full-time

USD 124,000.00 - 181,000.00 per year

Software Engineer - Inference

Laurel, Maryland

•

Today

Description Active Top Secret (TS/SCI) clearance with polygraph is required. Visionist has an exciting new, fully FUNDED opportunity for a Software Engineer - Inference on our largest PRIME contract. Our team of Analysts and Engineers is motivated by the direct impact on the mission, crafting specialized tools for enhanced efficiency and quick iterations for our operations user base. Seeing your tools in real-time action brings immediate gratification. This premier program encompasses tradition

Full-time

USD 85,000.00 - 120,000.00 per year

Software Engineer 1 - (Python, Kubernetes, AWS)

Annapolis, Maryland

•

Today

Software Engineer 1 - (Python, Kubernetes, Helm) Clearance: TS/SCI - Polygraph required Position ID: 20-24-024-SWE1 Location: Annapolis Junction, Maryland Description: Join us in building the next generation of AI infrastructure that will power innovation across the customer organization. We're seeking a software engineer to support our AI infrastructure team. In this role, you'll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-en

Full-time

USD 163,000.00 - 199,000.00 per year

Search all similar jobs

More jobs at Black Eagle Defense in Fort Meade, MD