11-19 更新 实时
首页/ 算力/ 正文

问答:组织如何提升自动化 AI 系统的公平性

算力 来源:TechXplore 2026-11-10 20:20 0 阅读 机器翻译
问答:组织如何提升自动化 AI 系统的公平性

编辑:Sadie Harley,审校:Andrew Zinin

本文已按照 Science X 的编辑流程和政策进行审核。编辑在确保内容可信度的同时,重点强调了以下特性:

添加到首选来源

在医疗、刑事司法和金融等高风险行业中,关键决策正越来越多地由人工智能(AI)系统做出,这引发了人们对这些系统如何得以公平实施的一波伦理与法律担忧。如今,宾夕法尼亚州立大学(Penn State)的一位研究人员与合作伙伴开展的一项新研究提出了关于 AI 公平性的整体性理论,同时提供了一个可供组织机构用来管理这一复杂问题的适用框架。

共同作者、宾夕法尼亚州立大学斯米尔商学院(Smeal College of Business)信息系统助理教授 Jing Tian 表示,AI 自动化决策中的公平性是一个不断演变的问题,必须考虑众多不同利益相关方的视角,其中包括在公平服务与经济现实之间取得平衡。

这项发表在《MIS Quarterly》期刊上的研究提出的设计理论,通过常态化的人机协作来应对这些相互冲突的关切,将 AI 公平性视为类似网络安全那样需要持续管理的问题。

在下面的问答中,Jing Tian 讨论了提升 AI 公平性的复杂性,以及所提出的设计理论——名为“通过 AI 增强响应性实现公平性适配”(Fairness Adaptation through AI-augmented Responsiveness,简称 FAIR)——如何提供一个灵活的框架,以应对广泛行业中的这些问题。

问:组织机构如何利用 AI 系统做出自动化决策?

在急诊室对患者进行分诊、评估抵押贷款申请等许多行业中,个人和组织正在使用 AI 系统做出自动化决策。这些工具能够更快、更一致地做出决策,但它们也可能复现训练数据中存在的种种不平等与偏见。

例如,医疗领域使用的算法已表现出种族差异,招聘系统也令女性处于不利地位。当软件能够影响谁能获得治疗、谁有资格获得贷款时,我们需要追问的不仅是它是否准确,还包括它的决策是否公平。

问:在你最近的论文中,你是如何界定 AI 公平性这一问题的?

我和同事认为,AI 公平性并不是组织修好一次就能一劳永逸的问题。公平对不同的人意味着不同的东西,而这些多元视角往往彼此冲突,且没有简单的解决办法。我们将 AI 公平性界定为一种“社会技术悖论”——一组持续存在、相互关联且不断演变的张力,必须随着其发展主动加以管理。

我们识别出这些张力背后的三个根源。第一,不同的公平观可能相互冲突。例如,如果一个组织对所有人一视同仁,这未必能为女性或有色人种等历史上处于不利地位的群体带来公平的结果。

第二,公平可能与组织目标相冲突,包括 AI 系统的预测准确性、运营效率和盈利能力。最后,对个人公平的事,对某个群体——或整个社会——未必公平,反之亦然。这些相互竞争的要求造成了艰难的取舍,也造成了每一种可选方案都有其代价的局面。

设想一个用于对医院急诊科患者进行优先级排序的 AI 系统。医生可能倾向于对所有人采用同一套标准,而患者权益倡导者则可能优先考虑服务不足的群体。与此同时,医院管理者可能关注的是尽可能多地救治患者。

这些目标都合理,却常常方向相悖。这些张力不止于有偏见的数据,还深入到 AI 系统的设计方式。随着监管、组织优先级乃至社会期望不断演变,这些张力会反复出现,需要持续调整,而非一次性解决。

问:FAIR 提出了一个由两部分组成的解决方案。第一部分——一套发现并解决公平性问题的系统——是如何运作的?

我们把每个 AI 决策系统拆解为三个相互关联的层面:它使用的数据、生成预测的模型,以及将预测转化为决策的规则。组织可以用这一框架定位公平性问题出现在哪里,并进行有针对性的改进,而不是把整个系统当作一个内部运作抽象而不可捉摸的黑箱。

在每一层,团队都可以通过一个持续的自适应循环——发现问题(即识别问题)并加以解决——来管理公平性张力。AI 智能体与人类的协作是这一过程的关键部分,把 AI 的速度与规模同人类的判断力与问责结合起来。

在发现阶段,AI 智能体监控系统并标记新出现的差异,而人类专家解读这些发现并判断哪些问题需要关注。随后 AI 智能体提出并测试可能的改进方案,而人类评估其中的取舍并批准合适的变更。

问:该解决方案的第二部分为应对 AI 公平性问题设定了标准。这样的体系会是什么样子?

为了在整个组织的 AI 系统中管理公平性,我们提出一种共享标准,同时为本地判断留出空间。在公司层面,中央治理团队将建立公平性监测、文档记录、问责机制和人工审批的基线要求。随后,负责具体 AI 应用的各个团队可以针对自己所处理的决策调整这些流程。

一个重要原则是:风险越高,对人工监督的需求就越大。例如,组织可以允许一个推荐产品的 AI 工具在极少人工审核的情况下进行日常调整。然而,一个帮助决定谁获得医疗救治的系统,则应在严格得多的监督下运行。

组织还应征求员工、用户及其他利益相关方的反馈,以使这些标准始终能回应现实中的经验。

问:一个组织要成功在其 AI 系统中实施 FAIR,需要具备哪些条件?

在将这类方法付诸实践时,组织必须从思维方式的转变开始。正如组织无法通过一次性检查来解决网络安全或安全问题一样,它们也不能把 AI 公平性当作上线时勾选的一个选项。

要改善其 AI 系统中的公平性,组织需要持续监测、明确的问题响应责任,以及随着技术和期望的变化而不断学习的流程。

这同样需要投入。员工需要接受培训,以学会与 AI 智能体协作并解读公平性方面的关切;组织也需要投入资源,建立能够跨部门协调的有效治理团队。受 AI 决策影响的人还必须拥有清晰、便捷的渠道,来分享他们的经历。

我们预计这些变化需要一段学习期。初期收益可能有限,但随着组织建立起必要的能力,我们相信这一做法有望为构建更公平的 AI 系统提供一条有意义的路径。

Arun Rai 等,FAIR: A Design Theory for Artificial Intelligence Fairness,MIS Quarterly(2026)。DOI: 10.25300/misq/2026/17971

这篇报道的作者是谁?

生命科学与生态学学士。拥有微生物学实验室背景,并具备石油、天然气和可再生能源行业的医药新闻经验。完整简介 →

物理学硕士,拥有科研经历。资深科学新闻爱好者。在 Science X 的编辑工作中发挥关键作用。完整简介 →

引用:Q&A: How can organizations improve fairness in automated AI systems?(2026年11月10日),检索于2026年11月10日,来源:https://techxplore.com/news/2026-11-qa-fairness-automated-ai.html

本文件受版权保护。除为私人学习或研究目的进行的合理使用外,未经书面许可不得复制任何部分。内容仅供参考之用。

即时获取摘要文本(要点)

AI 公平性涉及公平、组织目标以及个体与群体结果之间不断演变的张力。所提出的 FAIR 框架将贯穿数据、模型和决策规则的持续人机监控与适配,同共享治理标准、利益相关方反馈以及随决策利害程度而扩展的人类监督结合起来。

本摘要由 LLM 自动生成。完整免责声明

译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。

查看英文原文(Q&A: How can organizations improve fairness in automated AI systems?)

edited by Sadie Harley, reviewed by Andrew Zinin

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

Add to Preferred Sources

information systems Credit: Unsplash/CC0 Public Domain

Critical decisions are increasingly being made by artificial intelligence (AI) systems in high-stakes industries like health care, criminal justice and finance, ushering in a wave of ethical and legal concerns over how these systems can be implemented fairly. Now, a new study by a Penn State researcher and collaborators proposes a holistic theory of AI fairness while providing an applicable framework that organizations can use to manage this complicated issue.

According to co-author Jing Tian, assistant professor of information systems at Penn State's Smeal College of Business, fairness in AI-automated decision-making is an evolving issue that must consider many different stakeholder perspectives, including balancing equitable services with economic realities.

The design theory proposed in the study, published in the journal MIS Quarterly, addresses these conflicting concerns through regular human-AI collaboration, treating AI fairness as a continuously managed problem similar to cybersecurity.

In the following Q&A, Tian discussed the complexities of improving AI fairness and how the proposed design theory—titled Fairness Adaptation through AI-augmented Responsiveness, or FAIR—can provide a flexible framework to address these issues across a wide range of industries.

Q: How are organizations using AI systems to make automated decisions?

Individuals and organizations are using AI systems to make automated decisions in many industries, such as triaging patients in an emergency room setting and evaluating mortgage applications. These tools can make decisions faster and more consistently, but they can also reproduce the inequalities and biases found in their training data.

Algorithms used in health care have shown racial disparities, for example, and hiring systems have disadvantaged women. When software influences who receives medical treatment or qualifies for a loan, we need to ask not only whether it is accurate, but also whether its decisions are fair.

Q: In your recent paper, how do you frame the issue of AI fairness?

My colleagues and I argue that AI fairness is not a problem organizations can fix once and forget. Fairness means different things to different people, and these diverse perspectives often conflict in ways that have no simple solution. We frame AI fairness as a "sociotechnical paradox"—a set of persistent, interconnected and evolving tensions that must be managed actively as they develop.

We identify three underlying sources of these tensions. First, different conceptions of fairness can conflict. For example, if an organization were to treat everyone equally, that may not produce equitable outcomes for historically disadvantaged groups like women or people of color.

Second, fairness can conflict with organizational goals, including predictive accuracy of the AI systems, operational efficiency and profitability. Finally, what is fair for an individual may not be fair for a group—or society as a whole—and vice versa. These competing demands create difficult trade-offs and situations where every available option has a downside.

Consider an AI system that prioritizes patients in a hospital emergency department. A physician might favor applying the same criteria to everyone, but a patient advocate might prioritize underserved communities. A hospital administrator, meanwhile, might focus on treating as many patients as possible.

These goals are all legitimate, yet they frequently pull in opposite directions. These tensions go beyond biased data and into how AI systems are designed. As regulations, organizational priorities and even societal expectations continue to evolve, these tensions will resurface, requiring ongoing adaptation rather than a one-time fix.

Q: FAIR proposes a two-part solution. How does the first part—a system for finding and resolving fairness issues—work?

We break each AI decision-making system into three connected layers: the data it uses, the model that generates predictions and the rules that translate those predictions into decisions. Organizations can use this framework to identify where fairness problems arise and make targeted improvements rather than treat the entire system as a black box whose inner workings are abstract and intangible.

At each layer, teams can manage fairness tensions through a continuous adaptive cycle of surfacing, or identifying, problems and resolving them. The collaboration between AI agents and humans is a crucial part of this process, combining AI's speed and scale with human judgment and accountability.

During surfacing, AI agents monitor the system and flag emerging disparities, while human experts interpret these findings and determine which issues require attention. AI agents then propose and test possible improvements, while humans evaluate the trade-offs and approve appropriate changes.

Q: The second part of the solution sets standards for addressing AI-fairness problems. What would such a system look like?

In order to manage fairness across an entire organization's AI systems, we propose shared standards with room for local judgment. At the firmwide level, a central governance team would establish baseline requirements for fairness monitoring, documentation, accountability and human approval. The individual teams responsible for specific AI applications could then adapt these processes to the decisions they handle.

An important principle is that the higher the stakes, the greater the need for human oversight. For example, organizations may allow an AI tool that recommends products to make routine adjustments with minimal human review. A system that helps determine who receives medical treatment, however, should operate under much stricter oversight.

Organizations should also seek feedback from employees, users and other stakeholders so these standards remain responsive to real-world experiences.

Q: What would it take for an organization to successfully implement FAIR in its AI systems?

When putting this kind of approach into practice, an organization must start with a shift in mindset. Just as they cannot address cybersecurity or safety concerns with a one-time inspection, organizations cannot treat AI fairness as a box to check at launch.

To improve fairness in their AI systems, organizations need ongoing monitoring, clear responsibility for responding to problems and a process for learning as technology and expectations change.

That also requires investment. Employees will need to be trained to work with AI agents and interpret fairness concerns, and organizations will need to devote resources to set up effective governance teams that can coordinate across departments. The people affected by AI decisions must also have clear and accessible avenues through which they can share their experiences.

We expect these changes to involve a learning period. The benefits may be limited at first, but as organizations develop the necessary capabilities, we believe this approach could provide a meaningful path toward fairer AI systems.

Arun Rai et al., FAIR: A Design Theory for Artificial Intelligence Fairness, MIS Quarterly (2026). DOI: 10.25300/misq/2026/17971

Who's behind this story?

Sadie Harley

BSc Life Sciences & Ecology. Microbiology lab background with pharmaceutical news experience in oil, gas, and renewable industries. Full profile →

Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile →

Citation: Q&A: How can organizations improve fairness in automated AI systems? (2026, November 10) retrieved 10 November 2026 from https://techxplore.com/news/2026-11-qa-fairness-automated-ai.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Get Instant Summarized Text (Gist)

AI fairness involves evolving tensions among equity, organizational goals and individual versus group outcomes. The proposed FAIR framework combines continuous human–AI monitoring and adaptation across data, models and decision rules with shared governance standards, stakeholder feedback and human oversight scaled to decision stakes.

This summary was automatically generated using LLM. Full disclaimer

This site uses cookies to assist with navigation, analyse your use of our services, collect data for ads personalisation and provide content from third parties. By using our site, you acknowledge that you have read and understand our Privacy Policy and Terms of Use.

原文为英文,正文由自动抓取并保留原文。

本文由采集器自动同步

原文发布于 TechXplore(Q&A: How can organizations improve fairness in automated AI systems?),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。

阅读原文 ↗