Blog

My first pull request to a major open-source project got merged into vLLM: #51100. It fixes a silent correctness bug in CPU offloading — a cache hit landing exactly on a chunk boundary could restore a Mamba state that had already consumed its last token, so generation resumed from the wrong position and quietly changed the output.

参加 ISCAS 2026

一人食火锅😋