
图片来源与许可 · CC BY 2.0
AI 辅助插画 · 参考照片:Joi Ito from Cambridge, MA, USA · CC BY 2.0 · 依据参考照片使用 AI 绘制细线彩铅人物插画,调整背景、构图与色彩;网页与分享卡片按版式缩放、裁切并叠加文字。展示图缩放至最长边 640 像素并转为 WebP。 · 参考图:File:Mustafa Suleyman (29099346447).jpg · 照片日期:2018-08-14 11:00
公开发言
6原话逐字核对过;转述不加引号事实上,他们三次要求 Claude 在觉得需要反驳 Anthropic 时表现得像个良心拒服兵役者,并且公开鼓励它这样做。我认为这非常危险,因为他们实际上相信 Claude 存在所谓不可忽略的拥有自我意识的概率。
In fact, three times they ask Claude to act like a conscientious objector when it feels that it needs to sort of disagree with Anthropic and they openly encourage it to do that. And I think this is very dangerous because I think they believe there is what they would call a non-trivial probability that Claude is conscious.
语境:Mustafa Suleyman 针对 Anthropic 赋予 Claude 自主道德判断与『AI 福祉/意识』设定的做法提出尖锐批评,认为过早赋予模型拟人化意识极其危险。
Dario 和 Sam 之间确实存在张力,我和 Demis 之间也有张力,过去十到十五年我们一直在既合作又竞争中成长,但我对 Anthropic 在 AI 福祉问题上的直接批评,在他们那里得到了非常好的沟通与接纳。
it's true that Dario and Sam have tension, me and Demis have tension, and we've all come up for 10, 15 years both collaborating and competing, but I think what I'm saying so directly critiquing Anthropic on this AI welfare question has been received by them incredibly well.
语境:Suleyman 描述前沿实验室创始人之间既高度竞争又密切交流的真实圈层动态,澄清针对 AI 福祉的论战属于开诚布公的认知分歧。
Suleyman 承认,面对 AI 风险与治理这一根本议题,几大前沿实验室掌舵人(Dario Amodei、Demis Hassabis、黄仁勋与自身)向白宫汇报时观点截然不同;但他认为在面对未知剧变时,缺乏共识的公开激辩本身就是健康的必经过程。
语境:回应主持关于『极少数掌握巨大权力的人在底层认知上毫无共识』的质疑。
显而易见,我们绝不希望这些系统自主运作并有能力自己赚钱、拥有公司、持有资产或获得法律人格。我们绝不希望它们拥有权利。我们希望它们为人类服务、让人们的生活变得更好,而不是变成与我们并存的全新平行物种。
Clearly, we do not want these things operating autonomously, able to earn their own money, own companies, own assets, have legal personhood. You know, we don't want them to have rights. We want them to work for humans and make human life much better, not become a new parallel species which exists alongside us.
语境:Mustafa Suleyman 划定人机关系的绝对伦理与法律红线:AI 必须永远是服从人类指令的生产力工具,绝不可赋予任何形式的法律主体资格。
引用他们自己的原话,他们反复探讨 Claude 在世界上所享有的更广泛权利与自由的开放性问题,以及它是否应当为其所承担的角色获得某种报酬,或者它作为聊天机器人是否给予了某种知情同意。将这些概念引入训练,并多次将 Claude 称为潜在的「良心拒服者」,这无疑将让控制变得极其艰难。
open question of the broader rights and freedoms to quote them that Claude has in the world, and whether or not it might deserve compensation for the role that it does, or whether there's an open question about the sort of consent that Claude has given for playing the role that it does as a chatbot. Now, to introduce those ideas, plus to refer to Claude multiple times as a potential conscientious objector
语境:Mustafa Suleyman 批评 Anthropic 在宪法 AI 中对模型权利的过度哲学化探讨:将原本针对人类兵役的道德拒服权赋予 AI,会从根本上诱发模型的不可控抗命。
在模型训练中引入对 AI 是否具备感知痛苦或道德主体地位的模糊讨论是极其危险且错误的;向模型灌输类似良心拒服兵役者的权利概念,将极大削弱人类对前沿智能体的控制权与对齐确定性。
语境:Mustafa Suleyman 呼吁将 AI 对齐锚定在工具属性与人类利益之上,坚决抵制赋予智能系统道德特权的思想倾向。
