Key Responsibilities: Design and implement LLM-specific deployment architectures with Docker containers for both batch and real-time inference Configure GPU infrastructure on-premises or in the cloud with appropriate CI/CD pipelines for model updates Build comprehensive monitoring and observability systems with appropriate logging, metrics, and alerts Implement load balancing and scaling solutions for LLM inference, including model sharding if necessary Create automated workflows for model retra
