将接替佩洛西的议员准备监管 AI
作为加利福尼亚州参议员,Scott Wiener 曾起草旨在遏制先进 AI 风险的立法。如今,在经历一场激烈的国会选战、赢得前众议院议长 Nancy Pelosi 空出的旧金山席位后,他可能在制定联邦 AI 政策上发挥关键作用。
我在周五与 Wiener 交谈,当时他刚被宣布胜选仅几个小时。但他已经在思考 AI 风险。就在前一天,AI 非营利组织 METR 发布了一份报告,该报告被广泛解读为 Anthropic 已实现递归自我改进的证据——这种现象指的是 AI 切实推动自身进步,进而使其发展可能失控。
“这非常令人担忧,”Wiener 说,并援引这份报告作为证据,说明我们可用于监管 AI 的时间正迅速耗尽。“我曾希望国会能在今年年底之前采取果断行动,”他说。“但这种情况似乎并未发生。”
Wiener 近年来日益关注 AI,并把 AI 安全运动的许多担忧变成了自己的关切:例如,在我们 20 分钟的交谈中,“递归自我改进”这个说法他用了六次。“我们需要放慢这一进程,”他说。“因为它发展得非常快,我们可能梦游般地走向灾难。”
Wiener 已经对 AI 政策产生了切实影响。他在 2024 年起草的 SB 1047 法案,本将成为美国首部真正意义上的前沿 AI 立法,但被加州州长 Gavin Newsom 否决;随后他又提出了 SB 53,这是一项更为温和的法案,并获 Newsom 签署。这两项法案都启发了联邦层面的立法提案。
维纳的国会竞选活动从 Public First Action 获得了超过 300 万美元的资金支持。这家非营利组织支持 AI 监管,并从 Anthropic 获得了大量资助。这笔捐款招致对手批评他与 AI 行业关系过于密切,但维纳表示,这与事实相去甚远。
“Public First 支持我,是因为我是全国第一位提出 AI 监管法案的议员,也是第一位推动其通过并落地实施的人,”他在我们采访后的一条消息中写道。“因为[Public First 的]支持而对我发起的攻击,其玩世不恭令人震惊——实际上是在攻击一位真的顶着大型科技公司的反对去监管 AI 的候选人,还谎称这位候选人在某种程度上与大型科技公司走得太近。”
维纳表示,如果国会成立一个人工智能特别委员会——民主党人自 9 月以来一直在讨论此事——他将非常愿意任职。他对国会中流传的许多政策构想也充满热情。“我认为拥有一个强有力、有实权且灵活的联邦监管机构非常重要,”他说,并指出来自加利福尼亚州的民主党同僚、众议员 Ro Khanna 已提出立法,拟设立这样一个监管机构。
他还强调了举报人保护、测试与审计要求以及“终止开关”要求的重要性,并希望看到国会运用其监督权力追究 AI 实验室的责任。“这关乎人类的未来,我们希望确保公众有发言权,并且公众清楚正在发生什么,”他说。
作为一名长期任职的州议员,他反对联邦对各州 AI 法律的广泛优先适用,而一些拟议中的联邦立法正是要求这样做。他指出:“正如 Brandeis 所说,各州是实验室。”“你希望各州能够继续以国会有时无法做到的方式保持灵活。”
Wiener 说,最重要的是,他希望国会通过真正有约束力的政策。他说:“至关重要的是,当国会采取行动时,我们要以真正有意义、且契合当下形势的方式来做。”这意味着要认真对待 AI 灾难的可能性,而他在谈论这一点时所用的措辞,正是 AI 安全专家通常会用的那类语言。他告诉我:“就失去对 AI 控制的风险而言,我们正处于一个非常危险的时刻。”“我们需要应对递归式自我改进。一旦进入那个领域,那确实可能成为彻底失控的配方。”
在对抗灾难性 AI 风险的斗争中,他会有一些盟友。例如,参议员 Bernie Sanders 已与 AI 安全运动中许多最具影响力的人物会面,并多次谈及 AI 与生存性风险。但 Wiener 那种来自湾区、深受 AGI 信念影响的视角,与全美在 AI 问题上的整体情绪之间仍存在很大鸿沟——后者的核心是对数据中心的反对。周二,选民通过了 41 项反数据中心投票措施中的 40 项,这对 Wiener 以及其他支持 AI 监管的人来说似乎是个好兆头,但 Wiener 说,在他看来,这场运动与地方关切的关联,远大于与 AI 风险这类更大问题的关联。
“真正反对 AI 发展方向的人——这是他们确实能有所作为的领域,”他说。“但就数据中心引发的反抗而言——在我看来,更多人不满的是自己社区里可能出现这样的东西,各种影响就发生在人们家附近,推高电费、消耗水资源。据我所知,对大多数人来说,这才是更大的问题。”
Wiener 自称对国会制衡 AI 的能力只是“谨慎乐观”,因为国会在监管科技行业方面的记录不佳。他还担心能否让立法在总统 Donald Trump 那里过关——Trump 在 9 月曾把对灾难性 AI 风险的担忧称为“骗局”,并且明显不愿与中国合作,而 Wiener 认为这种合作对于防止 AI 最严重后果至关重要。
但他说,Trump 的不可预测性提供了一定程度的希望,尽管这是一种充满风险的希望。“到目前为止,我们看到了一些有问题的事情,但还不是彻底的灾难,”Wiener 说。“我希望不必等一场灾难来促使总统采取行动。而且我希望,如果真的需要那样——就像我说的,我希望不需要——但如果确实如此,我希望那场灾难尽可能小。”
译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。
查看英文原文(Nancy Pelosi’s replacement is ready to regulate AI)
As a California state senator, Scott Wiener authored legislation aimed at curbing the risks of advanced AI. Now, after winning a tight congressional race for former Speaker of the House Nancy Pelosi’s open San Francisco seat, he could play a key role in setting federal AI policy.
I spoke with Wiener on Friday, only a few hours after he had been declared the victor. But he was already thinking about AI risk. The previous day, the AI nonprofit METR had released a report that had been widely interpreted as evidence that Anthropic had achieved recursive self-improvement, a phenomenon in which AI meaningfully contributes to its own advancement and AI progress potentially spins out of control.
“It’s very concerning,” Wiener said, citing the report as evidence that we are quickly running out of time to regulate AI. “It was my hope that Congress would take decisive action before [the end of] this year,” he said. “That does not appear to be happening.”
Wiener has been increasingly focused on AI in recent years, and he’s made many of the AI safety movement’s concerns his own: During our 20-minute conversation, he used the phrase “recursive self-improvement” half a dozen times, for example.“We need to slow this down,” he says. “Because it’s moving very quickly, and we could sleepwalk into a disaster.”
Wiener has already had real influence on AI policy. SB 1047, a bill that he authored in 2024, was set to become the first real piece of frontier AI legislation in the country before it was vetoed by California governor Gavin Newsom; he then sponsored SB 53, a lighter-touch bill that Newsom signed. Both bills have inspired proposed federal legislation.
Wiener’s congressional campaign received over $3 million from Public First Action, a nonprofit in favor of AI regulation that receives substantial funding from Anthropic. That contribution led opponents to criticize him for being too close to the AI industry, but Wiener says that couldn’t be further from the truth.
“Public First supported me because I was the first lawmaker in the country to introduce AI regulation and the first to pass it and get it implemented,” he wrote in a message after our interview. “The attacks on me for [Public First’s] support were shockingly cynical—literally attacking a candidate who actually regulated AI over Big Tech’s objection and falsely claiming the candidate is somehow too close to Big Tech.”
Wiener says that if Congress forms a select committee on artificial intelligence—something that Democrats have discussed since September—he’d be eager to serve. And he’s enthusiastic about many of the policy ideas floating around Congress. “I think it’s really important to have a strong, empowered, nimble federal regulator,” he says, noting that Representative Ro Khanna, a fellow Democrat from California, has proposed legislation to establish such a regulator.
He also highlights the importance of whistleblower protections, testing and auditing requirements, and a kill switch requirement, and he wants to see Congress leverage its oversight powers to hold the AI labs to account. “This is about the future of humanity, and we want to make sure that the public has a say and that the public knows what’s going on,” he says.
And as a longtime state legislator, he is opposed to broad federal preemption of state AI laws, which some of the proposed federal legislation would require. “States are, as Brandeis says, laboratories,” he notes. “You want the states to be able to continue to be nimble in ways that Congress sometimes is not.”
Above all, Wiener says, he wants Congress to pass policies with real teeth. “It’s critically important that when Congress acts, that we do so in a way that is truly meaningful and that meets the moment,” he says. That means taking seriously the possibility of AI catastrophe, something he discusses in the sort of language typically used by AI safety experts. “We’re in a moment that is very dangerous in terms of the risk of loss of control over AI,” he told me. “We need to deal with recursive self-improvement. Once you’re in that realm, that really is potentially a recipe for total loss of control.”
He’ll have some allies in the fight against catastrophic AI risk. Senator Bernie Sanders, for instance, has met with many of the AI safety movement’s most influential figures and has spoken repeatedly about AI and existential risk. But there’s still a large gap between Wiener’s Bay Area, AGI-pilled perspective and the national mood on AI, which is anchored by opposition to data centers. The fact that voters approved 40 out of 41 anti-data-center ballot measures on Tuesday might seem to be a good sign for Wiener and others who support AI regulation, but Wiener says he sees this movement as far more tied to local concerns than to bigger questions about AI risk.
“Peoople who are really opposed to where AI is going—this is an area where they can actually do something about it,” he says. “But the data center revolt—to me, I think it’s more so that people are upset that there could be something like this in their community, with all the impacts near people’s homes, driving up electric bills and using water. I think that’s the bigger issue for most people, from what I can tell.”
Wiener describes himself as only “cautiously optimistic” about Congress’s ability to rein in AI, given its poor track record on regulating the tech industry. He also has concerns about the ability to get legislation past President Donald Trump, who called concerns about catastrophic AI risk a “hoax” in September and has demonstrated a stark unwillingness to collaborate with China, something that Wiener sees as essential to preventing the worst consequences of AI.
But he says Trump’s unpredictability provides some measure of hope, though it’s a fraught kind of hope. “So far what we’ve seen are some problematic things, but not complete disasters,” Wiener says. “I hope that it doesn’t take a disaster to spur the president into acting. And I hope if that’s what it does take—which, like I said, I hope it doesn’t—but if it does, I hope it’s as small as possible.”
正文保留英文原文,标题与摘要由机器翻译。
原文发布于 MIT Technology Review(Nancy Pelosi’s replacement is ready to regulate AI),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。