返回列表
更多 →
llama : add a GPU cache for MoE experts kept in host memory by am17an · Pull Request #29887 · ggml-org/llama.cpp
国外 · 猫头鹰笔记 · 发布于 2026-10-07 · 0 次阅读
来源：Reddit r/LocalLLaMA · 2026-10-07 · 新型 AI / 新品发布
Potentially big speedup for MoE models that don’t fully fit in VRAM. Are you GPU Poor? Show your speedups ;)   submitted by   /u/jacek2023 [link]   [comments]
本条资讯由「猫头鹰笔记」整理自 Reddit r/LocalLLaMA，仅作交流参考，版权归原作者所有。
