Independent project. Not a U.S. government website.

USASI

Release

TRL 1.15.0 released with a fused LM head enabled by default

Event: · Published:

On October 8, 2026 Hugging Face published version 1.15.0 of TRL on GitHub. The release notes say the SFT, DPO, KTO, GRPO, RLOO and Distillation trainers now score tokens with a fused LM head, a Triton kernel that avoids building the full logits tensor, and that it is on by default; scoring this way needs Triton on a GPU. The notes list breaking changes: a PEFT adapter on `lm_head` now raises an error, and `use_liger_kernel=True` is deprecated in the GRPO, RLOO, DPO and KTO trainers and will be removed in v2.0.0. The release also adds selective activation checkpointing in SFT. USASI has not tested these changes.1

Sources

  1. 1.
    TRL v1.15.0 (GitHub release notes) (external site: github.com)

    Hugging Face · Release notes · published Oct 8, 2026 · accessed Oct 9, 2026

Support Us

Help keep USASI useful.

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project