11-19 更新 实时
首页/ 科技公司/ 正文

OpenAI 首次向四家独立现场审计机构开放 AI 系统

科技公司 来源:The Decoder 2026-11-18 22:36 0 阅读 机器翻译

OpenAI 正向四家外部审计机构开放其内部 AI 系统的直接访问权限,以便这些机构实地调查安全风险和模型行为。OpenAI 宣布,该公司表示正在与 Apollo Research、METR、Transluce 和 Goodfire 合作。该项目建立在早前对其监控系统进行的一次实地审查之上,并履行了“白宫超级智能协议”中的承诺。

根据各自的任务安排,这些机构可在 OpenAI 的办公场所访问尚未发布的模型、源代码、训练数据和监控系统。他们还可以与开发者进行保密对话。Apollo Research 正在考察模型是否会暗中违背开发者的意图行事。METR 正在审查规模最大的强化学习训练运行中的 AI 不当行为——强化学习是一种让模型通过奖励进行学习的方法。Goodfire 正在分析模型内部流程,Transluce 则在评估后训练阶段的安全检查。OpenAI 与 Transluce 还计划在 2027 年初开展一次为期 8 周的后续审查。

一个独立的安全委员会监督整个流程,接收未经删减的报告,并调解争议。审计方独立发布其调查结果,但 OpenAI 可以对机密材料进行删减,并推迟报告发布以便先行修复风险。该公司预计初期会出现一些摩擦,但已在考虑开展更多审查,包括聚焦公司文化和内部流程的审查。

没有炒作的 AI 新闻——由人工精选

译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。

查看英文原文(OpenAI opens its AI systems to four independent on-site auditors for the first time)

OpenAI is giving four outside audit organizations direct access to its internal AI systems to investigate safety risks and model behavior on-site. The company says it's working with Apollo Research, METR, Transluce, and Goodfire, as OpenAI announced. The program builds on an earlier on-site review of its monitoring systems and fulfills commitments from the "White House Accord on Super Intelligence."

Depending on their assignment, the organizations get access at OpenAI's offices to unreleased models, source code, training data, and monitoring systems. They can also speak confidentially with developers. Apollo Research is examining whether models secretly work against their developers' intentions. METR is reviewing AI misbehavior in the largest reinforcement learning training run, a method where models learn through rewards. Goodfire is analyzing internal model processes, and Transluce is evaluating post-training safety checks. OpenAI and Transluce are also planning an eight-week follow-up review for early 2027.

An independent safety board oversees the entire process, receives unredacted reports, and mediates disputes. The auditors publish their findings independently, but OpenAI can redact confidential material and delay reports to fix risks first. The company expects some friction early on but is already considering more reviews, including ones focused on company culture and internal processes.

AI News Without the Hype – Curated by Humans

原文为英文,正文由自动抓取并保留原文。

本文由采集器自动同步

原文发布于 The Decoder(OpenAI opens its AI systems to four independent on-site auditors for the first time),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。

阅读原文 ↗