llm-d — USASI news https://unitedstatesofamericasuperintelligence.com/open/llm-d/ Dated, sourced news items in the USASI catalog that mention llm-d. Independent project. Not a United States government website. en-us Tue, 13 Oct 2026 12:00:00 GMT llm-d 0.10.0 focuses on operational hardening and deprecates its own CUDA and AWS images https://unitedstatesofamericasuperintelligence.com/news/llm-d-0-10-0-released/ https://unitedstatesofamericasuperintelligence.com/news/llm-d-0-10-0-released/ Tue, 13 Oct 2026 12:00:00 GMT release The llm-d project published version 0.10.0 on GitHub on September 29, 2026. The release notes name operational hardening and production readiness as the main themes and describe a new image build arrangement: images from main and official releases go to ghcr.io and are signed publicly with cosign, while images built from open pull requests go to quay.io and are not signed. The notes deprecate the ghcr.io/llm-d/llm-d-cuda image in favor of docker.io/vllm/vllm-openai and the llm-d-aws image in favor of an AWS vLLM container, and say the llmd-fs-connector has been integrated into vLLM as the OffloadingConnector. The llm-d-workload-variant-autoscaler repository has been renamed llm-d-autoscaling. USASI has not tested this release. Red Hat AI 3.5 becomes generally available with EvalHub and wider llm-d support https://unitedstatesofamericasuperintelligence.com/news/red-hat-ai-3-5-generally-available/ https://unitedstatesofamericasuperintelligence.com/news/red-hat-ai-3-5-generally-available/ Tue, 13 Oct 2026 12:00:00 GMT release Red Hat announced on September 9, 2026 that Red Hat AI 3.5 is generally available, including as part of Red Hat AI Factory with NVIDIA. The release makes EvalHub generally available for safety benchmarking and compliance reporting before deployment, shows Garak results on evaluated catalog models, integrates NeMo Guardrails to intercept malicious tool calls, and adds AutoRAG and observability features such as per-user token metering and MLflow agentic tracing. Red Hat says llm-d distributed inference now extends beyond OpenShift to third-party Kubernetes services, generally available on CoreWeave CKS and Microsoft Azure, with Amazon EKS in technology preview. USASI has not tested Red Hat AI 3.5.