Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
arXiv AI · 2026/8/3 17:35:31
Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation
AI 中文解读
AI公平性研究又有新突破!这篇论文揭示了一个容易被忽视的关键问题:当AI生成“美国的CEO”时,该拿什么标准来衡量它是否公平?过去评估AI偏见时,研究人员通常自己定一个“正确答案”,却没解释这个标准凭什么合理。作者提出了一个系统框架,把目标构建拆解成评估对象、先验许可、分配方式和操作方法四个环节,并通过AP-Bench测试发现,换用不同标准会让AI的公平性得分出现从0.279到0.355的显著波动。
这意味着“拿什么做对比基准”本身就是公平性评估的核心环节,而非前置小事。对普通人来说,这关系到AI在招聘、贷款审批、医疗推荐等场景中能否真正公平对待每一个人。如果评估标准本身就不靠谱,那么AI声称的“公平”可能只是幻觉。这项研究推动AI评测更加严谨透明,在AI日益深入日常生活的今天,无疑是一份值得关注的警示与指引。
Fairness evaluation concerns not only what a model produces, but also what its outputs ought to be compared against. When a model generates "a CEO in the United States," the prompt leaves demographic realization to the model. Existing group fairness definitions assume that sensitive attributes are given on the input side. Generative audits instead examine output-side demographic composition, yet the targets they compare it against are typically supplied rather than justified. The upstream question is what the target distribution should be. We formalize this missing-target problem for demographic-value-unspecified generation and decompose target construction into four commitments: the evaluative object, prior admissibility, allocation, and operationalization. In this framework, we admit the geographic prior under a geographic-membership interpretation for the declared public-world use. The occupational prior, under an incumbency interpretation, requires an independently defended objective such as workforce-composition fidelity. Instantiating this construction in AP-Bench, we find substantial distribution divergence from geography-derived targets, ranging from 0.508 to 0.606 on a 0-to-1 scale. Replacing each geography-derived target with an equal-category comparator, while holding generations and measurement fixed, produces model-specific mean absolute cell-level $\mathrm{JSD}_2$ changes ranging from 0.279 to 0.355. Target construction is therefore not a preliminary to fairness evaluation but a component of it. What we supply is not a universal target, but a framework that makes explicit the justification required before a distribution can serve as a fairness standard.
分享
阅读原文 ↗