11-19 更新 实时
首页/ 算力/ 正文

澳大利亚将对 AI 实施强制安全规则,风险方向对吗

算力 来源:TechXplore 2026-11-12 00:00 0 阅读 机器翻译
澳大利亚将对 AI 实施强制安全规则,风险方向对吗

由 Lisa Lock 编辑,Andrew Zinin 审阅

本文已按照 Science X 的编辑流程与政策进行审核。编辑在确保内容可信度的同时,重点标注了以下属性:

由研究人员撰写

添加到首选来源

澳大利亚总理 Anthony Albanese 刚刚宣布了六项强制性人工智能(AI)安全防护机制。

政府将设立新的 AI 安全监管机构来执行这些法规,并有权施加重大处罚。

根据这些防护机制,前沿 AI 公司——即拥有处于 AI 发展最前沿、最强大 AI 模型的公司——必须:

实施安全控制措施

识别并管理严重风险

允许对其模型进行独立评估

将严重事件迅速通报政府

发布安全与安保框架,以增强治理与透明度

随着技术变化,对更新后的标准与规则作出响应。

落实这些防护机制,是政府于9月启动的快速审查所提出的18项建议之一。该审查的起因是,OpenAI 部署的一个用于收集数据的智能体访问了非公开的 Medicare 统计数据。

在幕后,政府正在推进一项涵盖广泛的科技法律与政策改革议程。其中包括针对线上市场的不公平交易行为新禁令、一项旨在应对在线平台和 AI 聊天机器人所致危害的数字注意义务法案、一项重要的隐私法改革草案,以及对澳大利亚主权 AI 能力的调查。

总理的宣布聚焦于「AI 安全」「AI 安保」以及「前沿」AI 模型和公司。但澳大利亚人可能仍无法免受已知 AI 危害的影响——这些危害虽不那么引人注目,却已经广泛存在且十分严重。

多元化的 AI 政策与监管路径

除了强制性防护机制外,这份快速审查的建议还包括刑法改革、国际合作,以及加强政府与前沿 AI 开发者沟通对接的机制。

近一半的建议都涉及提升澳大利亚对 AI 相关网络事件的应对准备。

这些建议是合理的。审查强调能力建设、关系构建与合作的作用,这一点是正确的。有效且能及时响应的 AI 监管,不能只靠政府发布并执行僵化的规则。

尽管有这些优点,政府似乎对“AI 安全”的含义采取了狭隘的理解。

什么算作 AI 安全?

这一公告似乎表明,最重要的风险来自前沿 AI 模型。

但 AI 带来的风险——包括对安全、公共卫生和国家安全的严重风险——并不局限于前沿。

AI 与算法系统正日益融入医疗、保险、住房、金融、就业、教育和社会保障等重要服务领域。

在大多数情况下,这类 AI 系统不太可能是前沿 AI。相反,它们往往是更小、更专用的工具,例如 AI 招聘机器人、AI 个人预算管理应用或教育评分算法。

这类日常 AI 系统若在部署中缺乏问责、有失公平、管理混乱,有可能造成巨大危害。

我们已看到 Robodebt 伤害了数十万澳大利亚人。带有性别歧视的 AI 招聘工具、让枪支进入墨尔本板球场的 AI 场馆安保系统、带有种族歧视的警务算法,以及推荐有毒食谱的 AI 膳食规划器,只是日常 AI 危害与风险数千个案例中的几个。

正如 Medicare 事件所显示的,风险也会从软件系统、组织机构与现实世界情境之间的交互中产生。脱离具体情境,只关注强大的 AI 模型并不合理。

更糟的是,AI 系统以不透明著称。尽管隐私法的修订很快将要求企业和政府在隐私政策中说明其是否使用自动化决策,但在大多数领域,澳大利亚人无权获得对 AI 决策的实际解释。

关于(非前沿)AI 系统如何开发和部署缺乏透明度,是问责的一大严重障碍。

澳大利亚政府在 2024 年早些时候提出强制性 AI 防护机制时,已认识到这一切。然而,这些提案在很大程度上已被放弃,转而采取更宽松的监管方式。

2024 年的提案设想设立 10 项防护机制,既适用于部署在高风险场景中的非前沿 AI 系统,也适用于前沿系统。

这些机制原本会包含对透明度、问责、测试、数据治理、记录留存、风险管理、系统的人工监督以及质疑 AI 决策的途径等方面的要求。

这些防护机制大多没有出现在新清单中。例如,如今只有安全框架需要保持透明。

独立监督似乎仅限于评估 AI 模型本身,而不是评估在各种场景下 AI 系统的开发和部署是否安全、公平、负责任或可问责。

同样也没有通用的记录留存或透明度防护机制,来形成真正开展监督与问责所需的书面记录。

有一个看起来有希望的方向,即要求回应新的标准和规则。取决于防护机制如何落地,像澳大利亚那套细致而完善的自愿性 AI 安全标准(Voluntary AI Safety Standard)这样的标准,可以为促进公平、透明和问责提供更详细的指引。

如果对某些标准的合规成为强制要求,那么防护机制的影响就能更深、更广。

同样,提出对失职的 AI 开发者追究刑事责任的建议,也能激励其更好地留存记录、更主动地进行风险管理。

但在政府把这份由要点罗列构成的防护机制与快速审查建议清单进一步细化之前,外界很难判断 AI 安全监管的范围究竟会有多广。

就目前而言,有一点是明确的。针对诸如“失控”AI 智能体攻击政府或基础设施这类科幻式前沿风险出台监管,在政治上是有利的,政策上也站得住脚。但仅凭这一点,并不足以保护澳大利亚人免受 AI 带来的严重危害。

由 The Conversation 提供

这篇报道的作者是谁?

文学学士,艺术史专业;文学硕士,物质文化专业。曾任博物馆编辑、急救员和移植协调员。自 2021 年起为 Science X 担任编辑。完整简介 →

物理学硕士,具备科研经历。长期关注科学新闻。在 Science X 的编辑工作中发挥关键作用。完整简介 →

本文依据知识共享许可协议从 The Conversation 转载。阅读原文。

引用信息:澳大利亚将对 AI 实施强制性安全规则。我们是否聚焦于正确的风险?(2026 年 11 月 11 日)于 2026 年 11 月 11 日检索自 https://techxplore.com/news/2026-11-australia-impose-mandatory-safety-ai.html

本文档受版权保护。除出于私人学习或研究目的的合理使用外,未经书面许可,不得复制本文档的任何部分。本内容仅供参考之用。

澳大利亚新出台的 AI“防护机制”如何整顿混乱的人工智能市场

澳大利亚计划监管“高风险”AI。以下是成功实现这一目标的方法

观点:监管 AI 的最佳方式或许恰恰是不专门针对 AI 进行监管

澳大利亚的国家计划称现有法律足以监管 AI。这是一种虚假的希望

研究人员称,80% 的澳大利亚人认为 AI 风险是全球优先事项——政府需要加大行动力度

超声波与 AI 让现成的智能手表无需摄像头即可实现全身追踪

有机半导体片材实现无需外部电压的光驱动水分解

尽管行业规则已出台十年之久,日本大多数热门手游仍未完全公开开箱概率

3D 打印的机器青蛙依靠光驱动的六条人工肌肉游动

工程师挑战数字音频传感领域延续 90 年的局限

PRISM 通过让机器人学习力与运动如何相互作用,帮助其更好地移动

获取即时摘要文本(要点)

澳大利亚的六项强制性 AI 防护机制聚焦于前沿模型和网络安全。它们省略了此前提出的若干针对日常高风险 AI 的保障措施,包括记录留存、人工监督以及质疑决策的途径。要应对已存在的危害并确保各类部署场景下的问责,需要更广泛的监管。

本摘要由 LLM 自动生成。完整免责声明

译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。

查看英文原文(Australia will impose mandatory safety rules on AI. Are we focused on the right risks?)

edited by Lisa Lock, reviewed by Andrew Zinin

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

written by researcher(s)

Add to Preferred Sources

jail ai Credit: Unsplash/CC0 Public Domain

Prime Minister Anthony Albanese has just announced six mandatory artificial intelligence (AI) safety guardrails.

The government will establish a new AI safety regulator to enforce the regulations, with the power to impose significant penalties.

According to the guardrails, frontier AI companies—the ones with the most powerful AI models at the cutting edge of AI development—will have to:

implement security controls

identify and manage serious risks

allow independent evaluation of their models

rapidly notify government of serious incidents

publish safety and security frameworks to enhance governance and transparency

respond to updated standards and rules as technologies change.

The implementation of the guardrails is one of 18 recommendations from a rapid review the government launched in September after an AI agent, deployed by OpenAI to collect data, accessed nonpublic Medicare stats.

In the background, the government is pursuing an extensive agenda of technology law and policy reform. There's a new prohibition on unfair trading practices focused on online markets, a digital duty of care bill to address harms from online platforms and AI chatbots, a significant draft privacy law reform bill and an inquiry into Australia's sovereign AI capability.

The prime minister's announcement focuses on "AI safety," "AI security" and "frontier" AI models and companies. But Australians may remain unprotected from known AI harms that—though less spectacular—are already widespread and serious.

A diversified approach to AI policy and regulation

As well as the mandatory guardrails, the rapid review recommendations included criminal law reform, international cooperation and strengthening mechanisms for government engagement with frontier AI developers.

Nearly half of the recommendations are about increasing Australia's preparedness for AI-related cyber incidents.

The recommendations make sense. The review is right to emphasize the role of building capacity, relationships and cooperation. Effective and responsive AI regulation must go beyond the government simply issuing and enforcing rigid rules.

Despite these strengths, the government seems to be taking a narrow view of what "AI safety" means.

What counts as AI safety?

The announcement seems to indicate that the most important risks come from frontier AI models.

But risks from AI—including serious risks to safety, public health and national security—are not confined to the frontier.

AI and algorithmic systems are increasingly integrated into important services such as health care, insurance, housing, finance, employment, education and social security.

For the most part, these kinds of AI systems are not likely to be frontier AI. Instead, these would be smaller, more specialized tools, such as an AI recruitment bot, an AI personal budgeting app or an educational grading algorithm.

Unaccountable, unfair, poorly managed deployments of such everyday AI systems have the potential to cause enormous harm.

We've seen Robodebt harm hundreds of thousands of Australians. Sexist AI-enabled job recruitment tools, AI-enabled stadium security systems that let a gun into the Melbourne Cricket Ground, racist policing algorithms and AI meal planners that recommend poisonous recipes are just a few among thousands of examples of everyday AI harms and risks.

As the Medicare incident showed, risks also emerge from interactions between software systems, organizations and real-world contexts. It doesn't make sense to just focus on powerful AI models out of context.

Worse, AI systems are notoriously opaque. While changes to privacy law will soon require businesses and government to state in their privacy policies if they use automated decision-making, Australians don't have a right to an actual explanation of AI decisions in most domains.

A lack of transparency about how (nonfrontier) AI systems are developed and deployed is a serious impediment to accountability.

The Australian government recognized all of this in an earlier 2024 proposal for mandatory AI guardrails. However, these have largely been abandoned in favor of a lighter regulatory touch.

The 2024 proposal contemplated 10 guardrails that would apply to nonfrontier AI systems deployed in high-risk settings, as well as frontier systems.

These would have included requirements for transparency, accountability, testing, data governance, record-keeping, risk management, human oversight of systems and pathways for contesting AI decisions.

Most of those guardrails are missing from the new list. Now, only safety frameworks need to be transparent, for instance.

Independent oversight seems limited to evaluating AI models themselves, rather than evaluating whether the development and deployment of AI systems in various contexts is safe, fair, responsible or accountable.

There are also no general record-keeping or transparency guardrails that would create the paper trails we need for real oversight and accountability.

One area that looks promising is the requirement to respond to new standards and rules. Depending on how the guardrails are implemented, standards such as Australia's nuanced and sophisticated Voluntary AI Safety Standard could provide more detailed guidance to promote fairness, transparency and accountability.

If compliance with certain standards were mandated, then guardrails could have a deeper and wider reach.

Similarly, a proposal to introduce criminal liability for negligent AI developers could incentivize better record-keeping and more proactive risk management.

But until the government fleshes out this bullet-point list of guardrails and rapid review recommendations, it will be hard to know how broad the scope of AI safety regulation will be.

For now, one thing is clear. Introducing regulation for sci-fi frontier risks such as "rogue" AI agents attacking our government or infrastructure is good politics and sound policy. But it's not enough to keep Australians safe from serious AI harms.

Provided by The Conversation

Who's behind this story?

Lisa Lock

BA art history, MA material culture. Former museum editor, paramedic, and transplant coordinator. Editing for Science X since 2021. Full profile →

Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile →

This article is republished from The Conversation under a Creative Commons license. Read the original article.The Conversation

Citation: Australia will impose mandatory safety rules on AI. Are we focused on the right risks? (2026, November 11) retrieved 11 November 2026 from https://techxplore.com/news/2026-11-australia-impose-mandatory-safety-ai.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

How Australia's new AI 'guardrails' can clean up the messy market for artificial intelligence

Australia plans to regulate 'high-risk' AI. Here's how to do that successfully

Opinion: The best way to regulate AI might be not to specifically regulate AI

Australia's national plan says existing laws are enough to regulate AI. This is false hope

80% of Australians think AI risk is a global priority—the government needs to step up, say researchers

Ultrasound and AI turn off-the-shelf smartwatch into full-body tracker without cameras

Organic semiconductor sheet enables light-driven water splitting without external voltage

Most top mobile games in Japan still don't fully reveal loot box odds, despite decade-old industry rules

3D-printed robotic frog swims using six artificial muscles powered by light

Engineers challenge 90-year limitation in digital audio sensing

PRISM helps robots move better by learning how forces and motion interact

Get Instant Summarized Text (Gist)

Australia’s six mandatory AI guardrails focus on frontier models and cybersecurity. They omit several previously proposed safeguards for everyday high-risk AI, including record-keeping, human oversight and ways to contest decisions. Broader regulation is needed to address established harms and ensure accountability across deployment contexts.

This summary was automatically generated using LLM. Full disclaimer

This site uses cookies to assist with navigation, analyse your use of our services, collect data for ads personalisation and provide content from third parties. By using our site, you acknowledge that you have read and understand our Privacy Policy and Terms of Use.

原文为英文,正文由自动抓取并保留原文。

本文由采集器自动同步

原文发布于 TechXplore(Australia will impose mandatory safety rules on AI. Are we focused on the right risks?),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。

阅读原文 ↗