Independent project. Not a U.S. government website.

USASI

Release

llama.cpp server adds support for decision models through a /v1/systemone endpoint

Event: · Published:

On October 2, 2026 the ggml team announced on the Hugging Face blog that the llama.cpp server now supports decision models through a new /v1/systemone endpoint. Decision models score the options a caller supplies instead of generating text. The pull request that adds the endpoint (#29818) was merged into the llama.cpp repository the same day; it describes these models as wrappers around existing embedding-model architectures and adds a decision head and server handling for them. The announcement lists six supported models (Julia-1, Laya, Kev-4B, lev, OpenJev, and Clef), while the pull request itself covers five of them and lists Clef support as a planned follow-up.12

Sources

  1. 1.
    New in llama.cpp: Decision Models (external site: huggingface.co)

    ggml-org (Hugging Face) · Announcement · published Oct 2, 2026 · accessed Oct 5, 2026

  2. 2.
    llama, server: add /v1/systemone API (ggml-org/llama.cpp pull request #29818) (external site: github.com)

    ggml-org · Repository · published Oct 2, 2026 · accessed Oct 5, 2026

Support Us

Help keep USASI useful.

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project