11-21 更新 实时
首页/ 技术栈/ 正文

datasette-arrows 0.1a0

技术栈 来源:Simon Willison 2026-11-19 01:09 0 阅读 机器翻译
datasette-arrows 0.1a0

Datasette 1.0a43 新增了让插件实现流式导出格式的能力。Datasette 核心支持流式 CSV 和 TSV——你可以从一张表中导出数百万行数据,而无需将其全部加载到内存中,因为这两种文件格式支持分块流式传输数据。现在可以用 register_output_renderer() 插件钩子为其他格式实现同样的模式。

我学到的一条经验是:绝不要在发布新的插件功能时,不附带一个使用它的插件。

Claude Fable 5.2 建议采用 Apache Arrow 流式格式作为一个不错的选择,并且几乎一次性就构建出了这个插件。

把该插件安装到 Datasette(datasette install datasette-arrows),导出对话框就会多出这个新的 Arrow 选项:

这张截图来自 Datasette 的主分支——最新发布版本尚未把 Arrow 这类流式格式与 TSV、CSV 一起归入“All rows in this table”分区,但这将在下一个 alpha 版本中到来。

发布于 2026 年 11 月 18 日下午 5:09

本篇为 Simon Willison 的报道,发布于 2026 年 11 月 18 日。

每月赞助我 10 美元,即可获得一份精选的月度邮件摘要,涵盖当月最重要的 LLM 进展。

付钱给我,让我少给你发点!

译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。

查看英文原文(datasette-arrows 0.1a0)

Datasette 1.0a43 added the ability for plugins to implement streaming export formats. Datasette core supports streaming CSV and TSV - you can export millions of lines of data from a table without needing to load it all into memory, because those two file formats support streaming data in chunks. The register_output_renderer() plugin hook can now be used to implement the same pattern for other formats.

I've learned never to release a new plugin feature without accompanying it with a plugin that uses it.

Claude Fable 5.2 suggested the Apache Arrow streaming format as a good option, and built this plugin in almost a single shot.

Add the plugin to Datasette (datasette install datasette-arrows) and the export dialog gains this new Arrow option:

Export data modal for the threads table. The TSV and CSV exports are now joined by Arrow, showing "All 927 rows" and the text Apache Arrow IPC stream, for DuckDB, pandas, Polars and other tools. There is a Download button and a Copy URL button.

This screenshot is from Datasette's main branch - the most recent release doesn't yet group streaming formats such as Arrow with the TSV and CSV in the "All rows in this table" section, but that's coming in the next alpha release.

Posted 18th November 2026 at 5:09 pm

This is a beat by Simon Willison, posted on 18th November 2026.

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

原文为英文,正文由自动抓取并保留原文。

本文由采集器自动同步

原文发布于 Simon Willison(datasette-arrows 0.1a0),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。

阅读原文 ↗