返回列表
Two ~300B MoE models, each on ONE 128 GB mini PC (AMD Strix Halo): GLM-5.3-Flash at ~580 tok/s prefill, MiMo-V2.6-Flash
国外 · 猫头鹰笔记 · 发布于 2026-10-03 · 0 次阅读
来源:Reddit r/LocalLLaMA · 2026-10-03 · 新型 AI / 新品发布
We built an engine, Kyojin, on top of ExLlamaV3 for Strix Halo (gfx1151, ROCm), and packed two 300B-class MoE models so each fits one 128 GB machine. First release, all measured on Ryzen AI Max+ 395.
本条资讯由「猫头鹰笔记」整理自 Reddit r/LocalLLaMA,仅作交流参考,版权归原作者所有。

