Callo:预填充-解码分离下用投机解码处理缓存未命中
发件人:Jianjun Ou [查看邮件] [v1] 2026年11月13日星期五 17:28:37 UTC(1,037 KB)
查看论文 PDF:Callo: Serving Cache-Miss Requests with Speculative Decoding on Invalidated KV under Prefill-Decode Disaggregation,作者为 Jianjun Ou 及另外 1 位作者
BibTeX 格式引用
文献与引用工具
文献浏览器(什么是 Explorer?)
Connected Papers(什么是 Connected Papers?)
scite Smart Citations(什么是 Smart Citations?)
与本文相关的代码、数据和媒体
CatalyzeX 论文代码查找器(什么是 CatalyzeX?)
Hugging Face(什么是 Huggingface?)
Hugging Face Spaces(什么是 Spaces?)
推荐系统和搜索工具
Influence Flower(什么是 Influence Flowers?)
CORE Recommender(什么是 CORE?)
arXivLabs:与社区协作者合作的实验性项目
arXivLabs 是一个框架,允许协作者直接在我们的网站上开发和分享新的 arXiv 功能。
与 arXivLabs 合作的个人和组织都认同并接受了我们开放、社区、卓越和用户数据隐私的价值观。arXiv 坚守这些价值观,只与遵守这些价值观的合作伙伴合作。
你有能为 arXiv 社区带来价值的项目想法吗?了解更多关于 arXivLabs 的信息。
译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。
查看英文原文(Callo: Serving Cache-Miss Requests with Speculative Decoding on Invalidated KV under Prefill-Decode Disaggregation)
From: Jianjun Ou [view email]
[v1]
Fri, 13 Nov 2026 17:28:37 UTC (1,037 KB)
View a PDF of the paper titled Callo: Serving Cache-Miss Requests with Speculative Decoding on Invalidated KV under Prefill-Decode Disaggregation, by Jianjun Ou and 1 other authors
BibTeX formatted citation
Bibliographic and Citation Tools
Bibliographic Explorer(What is the Explorer?)
Connected Papers(What is Connected Papers?)
scite Smart Citations(What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers(What is CatalyzeX?)
Hugging Face(What is Huggingface?)
Hugging Face Spaces(What is Spaces?)
Recommenders and Search Tools
Influence Flower(What are Influence Flowers?)
CORE Recommender(What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
原文为英文,正文由自动抓取并保留原文。
原文发布于 arXiv cs.LG(Callo: Serving Cache-Miss Requests with Speculative Decoding on Invalidated KV under Prefill-Decode Disaggregation),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。