返回列表
更多 →
The Price of Token Boundaries: Compression Certificates and Prediction
国外 · 灯下漫谈 · 发布于 2026-09-30 · 0 次阅读
来源：arXiv cs.AI · 2026-09-30 · 新型 AI / 新品发布
arXiv:2609.35869v1 Announce Type: new Abstract: Pre-tokenisation restricts which text fragments can become prediction units, but its compression cost is obscured when tokenisers are compared only unde
本条资讯由「灯下漫谈」整理自 arXiv cs.AI，仅作交流参考，版权归原作者所有。
