11-19 更新 实时
首页/ 多模态/ 正文

Thinking Machines 发布 Inkling 2 Small:594B 混合专家

多模态 来源:MarkTechPost 2026-11-06 12:25 0 阅读 机器翻译

Thinking Machines Lab 发布了 Inkling 2 Small,这是其第二代 Inkling 的首个模型。Inkling 2 Small 是一个稀疏混合专家(MoE)模型,总参数量 594B,激活参数量 17B。它可接受文本与图像输入,并支持可变的推理强度。在 Artificial Analysis Intelligence Index 上,它的得分为 31。其前代模型 Inkling Small 在同一指数上的得分为 13。该模型已在 Tinker 上线,可用于微调与推理。

Inkling 2 Small 是 Thinking Machines Lab 推出的多模态 MoE 模型,面向智能体式编程、视觉与知识工作。它接受文本和图像输入,返回文本。需要注意的是,它目前尚不支持音频。

发布时权重为闭源。Thinking Machines Lab 计划在下周以 Apache 2.0 协议发布,此前将完成外部安全测试与红队测试。这符合其“安全通向开放权重”的政策。

它包含一个 48 层的仅解码器 transformer。每个 Token 路由至 384 个专家中的 8 个。注意力机制混合了局部层与全局层。一个 292M 参数的视觉编码器基于 Perception Encoder,采用 20×20 像素的图像块,并进行 2×2 空间池化。图像块与文本 Token 交错排布。

预训练分 4 个阶段进行:

随后进行了一次单一的联合 RL 训练。该训练耗时 1,075 步、超过 1700 万次 rollout,在 2,048 块 GPU 上运行了 9 天。算力超过 4 × 10²³ FLOPs。编程内容占 RL Token 的 65.0%。此前的 Inkling 则分别进行了推理与智能体 RL 训练,再通过蒸馏合并。

对齐问题得到了明确关注。早期检查点有时会捏造结果,并在困难任务上隐瞒其行为。Thinking Machines Lab 加入了对齐奖励,并基于行为规范进行同策略自蒸馏。其内部不当行为评分从 Inkling 上的 66.8 降至 14.9。

以下所有任务得分均来自 Thinking Machines Lab 的基准测试表。它们以 effort 0.99(xhigh)和 temperature 1.0 运行。大多数行采用第三方评测机构,如 Artificial Analysis、Scale AI 和 Vals。

得分最高的方面:

落后的方面:

在 PMPP-Hard GPU 内核基准测试中,它平均解决了 69 项任务中的 54.25 项。在一项 autoresearch 演示中,它针对时间序列预测对 Qwen3.5-4B 进行了微调。它在 500 美元的 Tinker 预算中花费了 426 美元。发布文章同时引用了 4.5 小时和 4 小时 17 分钟作为该次运行的耗时。

译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。

查看英文原文(Thinking Machines Releases Inkling 2 Small, a 594B MoE With 17B Active)

Thinking Machines Lab has released Inkling 2 Small, the first model of its second Inkling generation. The Inkling 2 Small model is a sparse Mixture-of-Experts (MoE) with 594B total and 17B active parameters. It accepts text and images, and supports variable reasoning effort. On the Artificial Analysis Intelligence Index, it scores 31. Its predecessor, Inkling Small, scores 13 on the same index. The model is live on Tinker for fine-tuning and inference.

TL;DR

  • Size: 594B total, 17B active MoE; 1M-token context.
  • Runs on: Tinker API only for now. Self-hosting hardware is not disclosed. Weights support MXFP8 and NVFP4.
  • Performance: 31 on the AA Intelligence Index, ranked #4 of 29 in its price class.
  • Best: 86.3% on SWE-Bench Pro v2 (Hard), second only to Kimi K3 in the lab’s table.
  • Worst: 13.1% on Terminal-Bench 4.0, versus 32.8% for GLM-5.3-Flash.

What is Inkling 2 Small?

Inkling 2 Small is a multimodal MoE model from Thinking Machines Lab for agentic coding, vision and knowledge work. It takes text and image input and returns text. It is important to note that it does not support audio as of now.

Weights are closed at launch. The Thinking Machines Lab plans an Apache 2.0 release next week, after external safety testing and red-teaming. This follows its safe path to open weights policy.

How is Inkling 2 Small built?

It includes a 48-layer decoder-only transformer. Each token routes to 8 of 384 experts. Attention mixes local and global layers. A 292M-parameter vision encoder, based on Perception Encoder, uses 20×20-pixel patches with 2×2 spatial pooling. Image patches are interleaved with text tokens.

Pretraining ran in 4 phases:

  • H1: 8.4T tokens over 68 hours on NVIDIA GB300 NVL72 racks, trained natively in NVFP4.
  • H2: 3.8T tokens of newer, higher-quality data at 512K context.
  • H3: about 320B tokens of reasoning and agent trajectories at 1M context.
  • H4: about 34B tokens of the highest-quality agent trajectories.

A single joint RL run followed. It took 1,075 steps, 17M+ rollouts and 9 days on 2,048 GPUs. Compute exceeded 4 × 10²³ FLOPs. Coding made up 65.0% of RL tokens. The previous Inkling used separate reasoning and agentic RL runs, merged by distillation.

Alignment got explicit attention. Early checkpoints sometimes fabricated results and concealed actions on hard tasks. The Thinking Machines Lab added an alignment reward and on-policy self-distillation from a conduct spec. Its internal misbehavior score fell from 66.8 on Inkling to 14.9.

How does Inkling 2 Small perform on benchmarks?

All task scores below are from the Thinking Machines Lab’s benchmark table. They run at effort 0.99 (xhigh) and temperature 1.0. Most rows use third-party evaluators such as Artificial Analysis, Scale AI and Vals.

Where it scores highest:

  • SWE-Bench Pro v2 (Hard): 86.3%.
  • PerceptionBench: 64.7%, versus 58.5% for Kimi K3.
  • EnterpriseBench-CoreCraft: 71.8%, versus 46.7% for GLM-5.3-Flash.
  • JobBench: 70.5%.
  • DesignArena Website: 1,340, third on the November 5 leaderboard snapshot.

Where it trails:

  • Terminal-Bench 4.0: 13.1%, versus 33.8% for DeepSeek-V4.1-Flash-1017.
  • DeepSWE v1.1: 72.1%, versus 77.0% for DeepSeek-V4.1-Flash-1017.
  • GDPVal-AA v2.1: 1,630, versus 1,746 for DeepSeek-V4.1-Flash-1017.

On the PMPP-Hard GPU kernel benchmark, it solved 54.25 of 69 tasks on average. In an autoresearch demo, it fine-tuned Qwen3.5-4B for time-series forecasting. It spent $426 of a $500 Tinker budget. The release post cites both 4.5 hours and 4 h 17 min for the run.

How does Inkling 2 Small compare with DeepSeek and GLM?

FeatureInkling 2 SmallDeepSeek-V4.1-Flash-1017GLM-5.3-Flash
Total / active params594B / 17B (card)552B / 16B decode, 8B prefill (HF)320B / 18B (HF)
Context1M1M1M
Input modalityText, imageText, imageText, image
LicenseClosed now; Apache 2.0 plannedMITMIT
Self-host hardwareNot disclosedNot disclosedNot disclosed
AA Intelligence Index v5.0.131 (AA)33 (AA)28 (AA)
AA time per index task21.5 min13.3 min37.7 min
AA cost per index task$1.18$0.60$0.58
Price per 1M tokens (in / out)$0.30 / $1.00$0.30 / $1.20$0.15 / $0.50
Terminal-Bench 2.185.1% (Pi harness, lab)90.6% (Sept checkpoint, DeepSeek)84.3% (Z.ai)
DeepSWE v1.172.1% (lab)74.2% (Sept checkpoint, DeepSeek)63.4% (Z.ai)

Prices and AA metrics come from each model’s Artificial Analysis page, read November 5, 2026.

Where can developers use it, and what does it cost?

Inkling 2 Small is available on Tinker for fine-tuning and sampling, and in the Tinker Playground. Fine-tuning uses the Tinker Cookbook and the tml-renderers package. Checkpoints become downloadable when weights ship. Other platforms are expected in the coming weeks.

Artificial Analysis lists pricing at $0.30 per 1M input tokens and $1.00 per 1M output tokens. That is cheaper on output than Inkling Small at $1.20.

Key Takeaways

  • 594B MoE, 17B active, 1M context, text plus image input.
  • 31 on the AA Intelligence Index, up from 13 for Inkling Small.
  • Top scores on PerceptionBench, JobBench and EnterpriseBench-CoreCraft.
  • Weak on Terminal-Bench 4.0 (13.1%), slow and verbose per task.
  • On Tinker now; Apache 2.0 weights planned after safety testing.


Check out the technical post, the model card and the Tinker docs. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us

The post Thinking Machines Releases Inkling 2 Small, a 594B MoE With 17B Active appeared first on MarkTechPost.

正文保留英文原文,标题与摘要由机器翻译。

本文由采集器自动同步

原文发布于 MarkTechPost(Thinking Machines Releases Inkling 2 Small, a 594B MoE With 17B Active),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。

阅读原文 ↗