11-19 更新 实时
首页/ 技术栈/ 正文

阿里发布 Qwen4-Max:2.4T MoE、71B 激活

技术栈 来源:MarkTechPost 2026-11-16 17:44 0 阅读 机器翻译

阿里巴巴 Qwen 团队发布了 Qwen4-Max,这是其 Qwen4 代的首个模型。Qwen4-Max 是一款专有稀疏 MoE 模型,主干参数规模达 2.4T,每个 Token 激活 71B 参数。它可接受文本、图像和视频输入,并支持 1M Token 的上下文窗口。阿里巴巴还下调了 API 价格,并称单任务平均成本下降 62%。

Qwen4-Max 是阿里巴巴推出的多模态 MoE 语言模型,面向长周期专业工作场景打造。本月仅开放了仅限 Token Plan 的预览版。

Qwen4 在 3 个方面升级了稀疏 MoE 设计:注意力、残差连接和嵌入层。

阿里巴巴称,在 2.4T 规模的预训练过程中未出现损失尖峰。在内部测试中,Qwen4-Max-Base 的每字节比特数(bits per byte)比 Qwen3.8-Max-Base 低 5% 至 13%,同时激活的参数还少了 25%。

阿里巴巴的对比图表覆盖 16 项基准测试。对比对象包括 Qwen3.8-Max-0902、Claude Opus 5.5、GPT-6.1 Sol、GPT-6 Astra 和 Kimi K3.1。其中多项分数引自第三方排行榜。发布时没有任何一项经过独立复现。

Qwen4-Max 在 16 项基准测试中有 4 项排名第一:

Claude Opus 5.5 在 16 张图表中的 7 项领先。Qwen4-Max 在编程和视觉方面落后最为明显:

在阿里巴巴自有的 Work360 基准测试中,Qwen4-Max 得分为 52.69,高于 Qwen3.8-Max 的 47.74。Work360 覆盖 26 个一级领域和 721 个专业方向。

两件事叠加在一起:Token 用量更少,价格更低。在 Work360 上,Xhigh effort 下 Token 用量下降约 24%,High effort 下下降 35%。在 Terminal-Bench 4.0 上,降幅约为 48% 和 49%。Work360 每任务平均成本从 $4.43 降至 $1.67,下降 62%。

列表价格也下降了。输入价格为每百万 Token $1.50,低于 Qwen3.8-Max 的 $2。输出价格为 $4.50,低于 $6。隐式缓存读取下降 70%,从 $0.25 降至 $0.075。

*分数来自阿里巴巴的 Qwen4-Max 图表。Qwen3.8 一列对应的是 Qwen3.8-Max-0902。该图表将 Kimi 标注为“Kimi K3.1”。Moonshot 自己发布的卡片显示,Kimi K3.1 Pro 的 Terminal-Bench 4.0 得分为 65.7,Opus 5.5 为 66.4。

模型 ID 在 QwenCloud 上为 qwen4-max。该 API 可与 OpenAI 兼容和 Anthropic 兼容的客户端配合使用。支持的功能包括函数调用、结构化输出、上下文缓存、批处理、网络搜索和微调。默认速率限制为每分钟 5,000,000 Token。思考模式通过 enable_thinking 切换。

订阅访问通过 Token Plan 提供。

查看官方 Qwen4-Max 博客、QwenCloud 模型页面和 Token Plan 定价页面。你可以通过我们的 GPULeaderboard.com Chrome 扩展在这里查看部署选项和规格。

需要与我们合作推广你的 GitHub 仓库、Hugging Face 页面、产品发布或网络研讨会等?联系我们

文章《Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context》最初发表于 MarkTechPost。

译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。

查看英文原文(Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context)

Alibaba’s Qwen team has released Qwen4-Max, the first model of its Qwen4 generation. Qwen4-Max is a proprietary sparse MoE model with a 2.4T-parameter backbone and 71B parameters active per token. It accepts text, images and video, and supports a 1M-token context window. Alibaba also cut API prices and reports a 62% drop in average cost per task.

TL;DR

  • Size: 2.4T backbone parameters, 71B active per token, plus 328B N-gram Embedding parameters. 1M context, 393K max output tokens.
  • Runs on: Hosted only: QwenCloud API, Token Plan, Qwen Studio, QwenWork and Qoder. No open weights, so no self-hosting or quantized builds.
  • Performance: A large jump over Qwen3.8-Max. Competitive with frontier models on agentic work, behind on hard coding and vision.
  • Best: HLAB-Vals-1.1 (legal agent work): 21.3, versus 11.7 for Kimi K3.1, the next-best model.

What is Qwen4-Max?

Qwen4-Max is a multimodal MoE language model from Alibaba, built for long-horizon professional work. A Token Plan-only preview opened this month only.

How does the Qwen4-Max architecture work?

Qwen4 upgrades the sparse MoE design in 3 places: attention, residual connections and embeddings.

  • GDN + Qwen Sparse Attention (QSA): Each QSA layer pairs with 3 Gated DeltaNet layers. These compress history into fixed-size states. QSA then uses a lightweight indexer to pick relevant context at micro-block granularity. This lowers attention and indexing cost on long sequences.
  • Gated Residual (GR): 4 parallel residual branches use dynamic read and write gates. The aim is stronger information flow and better training stability.
  • N-gram Embedding: 328B extra parameters provide lookups of local token patterns at layer 2. This adds capacity with little extra compute.

Alibaba reports no loss spikes across the 2.4T-scale pre-training run. On in-house tests, Qwen4-Max-Base shows 5 to 13% lower bits per byte than Qwen3.8-Max-Base. It does this while activating 25% fewer parameters.

How does Qwen4-Max perform on benchmarks?

Alibaba’s comparison chart covers 16 benchmarks. Rivals are Qwen3.8-Max-0902, Claude Opus 5.5, GPT-6.1 Sol, GPT-6 Astra and Kimi K3.1. Several scores are cited from third-party leaderboards. None were independently reproduced at launch.

Qwen4-Max ranks first on 4 of 16 benchmarks:

  • HLAB-Vals-1.1 (legal agents): 21.3, versus 11.7 for Kimi K3.1 and 9.2 for Opus 5.5.
  • Agents’ Last Exam v1.1: 46.7, versus 43.4 for Opus 5.5 and Kimi K3.1.
  • BioMysteryBench: 85.0, versus 84.4 for GPT-6.1 Sol.
  • DeepSWE v1.1: 75.7, versus 75.5 for Kimi K3.1.

Claude Opus 5.5 leads 7 of the 16 charts. Qwen4-Max trails most clearly on coding and vision:

  • ProgramBench: 31.5 versus 65.0 for Opus 5.5.
  • Terminal-Bench 4.0: 48.5 versus 67.2 for Kimi K3.1.
  • Chartography: 54.2 versus 71.1 for GPT-6 Astra.
  • Humanity’s Last Exam: 51.7 versus 59.8 for Opus 5.5.

On Alibaba’s own Work360 benchmark, Qwen4-Max scores 52.69, up from 47.74 for Qwen3.8-Max. Work360 spans 26 top-level domains and 721 specialized fields.

Why is Qwen4-Max cheaper to run?

Two things stack: fewer tokens and lower prices. On Work360, token use drops about 24% at Xhigh effort and 35% at High effort. On Terminal-Bench 4.0, the drops are about 48% and 49%. Average Work360 cost per task falls from $4.43 to $1.67, a 62% cut.

List prices fell too. Input is $1.50 per million tokens, down from $2 for Qwen3.8-Max. Output is $4.50, down from $6. Implicit cache reads drop 70%, from $0.25 to $0.075.

Qwen4-Max vs competitors

MetricsQwen4-MaxQwen3.8-MaxClaude Opus 5.5GPT-6.1 SolKimi K3.1 Pro
Total params2.4T backbone + 328B N-gram emb.2.4TNot disclosedNot disclosed2.8T
Active params71BNot disclosed (blog implies about 95B)Not disclosedNot disclosed104B
Context1M1M1M1,050,0001,048,576
Max output393K131K128K128KNot disclosed
Input modalitiesText, image, videoNot disclosedText, imageText, imageText, image
WeightsProprietary, API onlyNot disclosedProprietaryProprietaryOpen (Kimi K3.1 Pro License)
Input / output price (per 1M)$1.50 / $4.50$2 / $6$4 / $20$2 / $10$2 / $10
Cached input (per 1M)$0.075$0.25$0.20$0.10$0.20
DeepSWE v1.1*75.769.374.275.275.5
Terminal-Bench 4.0*48.538.959.656.167.2
Humanity’s Last Exam*51.743.959.854.051.1
ProgramBench*31.528.065.052.525.0
HLAB-Vals-1.1*21.315.49.26.311.7

*Scores from Alibaba’s Qwen4-Max chart. Qwen3.8 column is Qwen3.8-Max-0902. The chart labels Kimi as “Kimi K3.1”. Moonshot’s own card reports Terminal-Bench 4.0 of 65.7 for Kimi K3.1 Pro and 66.4 for Opus 5.5.

How can developers use Qwen4-Max?

The model ID is qwen4-max on QwenCloud. The API works with OpenAI-compatible and Anthropic-compatible clients. Supported features include function calling, structured outputs, context caching, batch processing, web search and fine-tuning. The default rate limit is 5,000,000 tokens per minute. Thinking mode is toggled with enable_thinking.

Subscription access runs through the Token Plan.

Key Takeaways

  • 2.4T MoE backbone, only 71B active per token.
  • New QSA attention, Gated Residuals and 328B N-gram Embeddings.
  • First on 4 of 16 charted benchmarks, led by HLAB-Vals-1.1 at 21.3.
  • $1.50/$4.50 per million tokens, cached input down 70%.
  • Weak spots: ProgramBench (31.5) and Terminal-Bench 4.0 (48.5).


Check out the official Qwen4-Max blog, the QwenCloud model page and the Token Plan pricing page. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension.

Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us

The post Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context appeared first on MarkTechPost.

正文保留英文原文,标题与摘要由机器翻译。

本文由采集器自动同步

原文发布于 MarkTechPost(Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。

阅读原文 ↗