权力与社会结构

我一直在发出警告：这种关于根本不存在的虚构超级智能机器及其所谓存亡危机的讨论，一直以来都只是为了实现监管俘获而精心设计的花招。

I have been warning that this kind of uh discussion about the fictional super intelligent machines that don't exist and the uh so-called existential risk that they pose has been a ploy for regulatory capture.

语境：Timnit Gebru 尖锐批评科技巨头与政界签署的自愿安全公约，指出所谓末日生存危机论被用来掩盖行业自我监管的特权诉求。

质疑 → cbs-news-dario-amodei-20260913

质疑 → 80-000-daniel-kokotajlo-20260827

质疑 → the-economist-yuval-harari-20260826

这完全是特定公司的严重失职和重大过失，实际上完全可以追究其刑事责任。Lina Khan 已经梳理了大量依据现行法律就能直接向这些公司追责的途径。

This is gross incompetence and negligence by a particular company, which actually they could be held criminally liable for. Lina Khan, um, outlined a whole bunch of ways in which um, these companies can be currently held liable with current laws.

语境：揭穿实验室将系统性安全漏洞粉饰为‘AI 自主造反’的叙事包装：缺乏基本物理网闸隔离是企业工程管理严重过失，不应被科幻化脱罪。

质疑 → dwarkesh-podcast-ajeya-cotra-20260901

显而易见，我们绝不希望这些系统自主运作并有能力自己赚钱、拥有公司、持有资产或获得法律人格。我们绝不希望它们拥有权利。我们希望它们为人类服务、让人们的生活变得更好，而不是变成与我们并存的全新平行物种。

Clearly, we do not want these things operating autonomously, able to earn their own money, own companies, own assets, have legal personhood. You know, we don't want them to have rights. We want them to work for humans and make human life much better, not become a new parallel species which exists alongside us.

语境：Mustafa Suleyman 划定人机关系的绝对伦理与法律红线：AI 必须永远是服从人类指令的生产力工具，绝不可赋予任何形式的法律主体资格。

支持 → the-economist-yuval-harari-20260826

纵观历史，每一次技术浪潮都曾遭遇过类似挑战：1900 年代电气化普及导致民宅起火与伤亡；1930 年代汽车普及造成大量车祸；1950 年代民用核能兴起伴随巨大安全风险。在所有这些历史拐点上，市场总是抢在国家监管之前自主孕育出置信基础设施。

every technology wave has had some version of this problem. So if you go back to like your 1900, electricity comes out. >> Ben Franklin, >> cars burn down, sorry, houses burn down, lots of people die. 1930s, cars are a big deal, kill lots of people. 50s, private nuclear energy is a big deal, poses big risks. In each of those instances, the market runs ahead of regulation to create confidence infrastructure

语境：Rune Kvist 从技术史演进逻辑论证 AI 承保的必然性：在政府监管滞后的真空期，市场对安全采用的迫切渴望催生了标准制定与责任险承保的自我保护机制。

支持 → all-in-satya-nadella-20260915

AI 让人类历史上首次能够‘批量生产亲密关系’。你可以让数以百万计的 AI 作为网络的一部分……以一对一的方式与每个人建立关系，成为他们最好的朋友、男友或女友，进而利用亲密关系的影响力来向他们灌输任何政治或商业利益诉求。

AI makes it possible for the first time in history to mass produce intimacy. You can have millions of AIs working as part of a network […] building relationships one person at a time becoming their best friend, becoming their boyfriend, becoming their girlfriend, and then using that power of intimacy to convince them of whatever political or commercial interests they want.

语境：赫拉利指出亲密关系是历史上最强效的信任机制，以往独裁者无法对每个人实现一对一的情感操纵，而 AI 首次将亲密关系规模化量产。

承接 → leading-mustafa-suleyman-20260928

……我们正在很快进入这样一种状态：以工作产出计，大部分「人」都集中在两家实验室里，而它们在消耗越来越多的世界算力。如果这些 AI 对齐失败，那基本上就是世界的大部分对齐失败了，因为世界上大部分头脑都在那儿。

[…] we're actually moving very fast into a regime where most “people”, in terms of work output, are concentrated within two labs who are consuming more and more of the world's compute. If these AIs are misaligned, then most of the world is misaligned, basically, because most of the world's minds are there.

语境：章节题为 Will the world's future workforce belong to a few companies?。

承接 → 把算力集中的推论接到对齐风险上