Bookshelf

Book 13 of 46

Empire of AI

Dreams and Nightmares in Sam Altman's OpenAI

By Karen Hao

621 pages, 15 chapters

Frameworks: 7

The frameworks here are Karen Hao's, from Empire of AI. Claude read the book in Tom's Brain and linked it to his lessons.

How Tom uses this

Empire of AI backs three of Tom's lessons. Under each of his lessons, what the book says about it, and on which pages.

What it argues

Karen Hao argues that OpenAI began as a sincere nonprofit but became an empire, because its mission to build AGI for the benefit of humanity is vague enough to justify centralising talent, capital, data, labour, land and water. Scale was a choice made by a few people in Silicon Valley and was never inevitable, and Sutskever's faith in deep learning, Altman's gift for storytelling and deal-making and Microsoft's money turned it into the industry's doctrine. The costs fall on data labellers in Kenya and Venezuela, on communities facing data centres in Chile and Uruguay, and on artists and writers whose work became training data, while the benefits accrue upward. The 2023 board crisis and the 2024 Omnicrisis show how a handful of fallible people, with no real checks, steer a technology that affects everyone. Hao closes with alternatives, small consent-based models such as Te Hiku's, and with a call to redistribute power over knowledge, resources and influence.

Worth keeping

  • Mission as a formula for power: talent, capital and resources get centralised behind a vague goal that can be reinterpreted at will (p. 413).
  • Altman's pattern, as reported by Murati, Sutskever and Amodei, of telling each person what they want to hear and avoiding putting things in writing, which ended in a board crisis (pp. 358, 362, 375).
  • Storytelling and networks as the real assets: Altman's fundraising skill, one-word intros and small bets at volume built an empire (pp. 43, 50).
  • Compute use in AI breakthroughs doubled every 3.4 months, and Hao calls scaling laws a self-fulfilling prophecy that no law of nature requires (pp. 71, 127).
  • Generative AI depends on hidden human labour, with moderators paid $1.46 to $3.74 an hour and workers blacklisted when a platform decides they are no longer useful (pp. 203, 233).
  • Survey of 2,500 workers: 96 percent of C-suite leaders expected generative AI to boost productivity, while 77 percent of employee users said it added to their workload (p. 28).
  • Altman's own warning that growing OpenAI too fast would dilute talent density and mission alignment, which then happened after ChatGPT (pp. 272, 273).
  • The employee letter showed founder dependence: over 700 of roughly 770 staff threatened to follow Altman, and Murati's equivocation helped tip the outcome (pp. 20, 379, 380).
  • The GPT-2 'too dangerous to release' episode doubled as publicity and policy positioning, a pattern to watch in any AI product claim (pp. 137, 138, 139).
  • Te Hiku Media's alternative: consent, reciprocity and sovereignty, a small task-specific model, 310 hours of data and two GPUs (pp. 423, 424, 425).

The questions it answers

  • What does AI actually change about the shape of a content team?

    The book documents the hidden annotation and moderation labour behind chatbots and a survey in which 77 percent of employee users said AI tools added to their workload.

  • How do you build a personal brand that generates inbound rather than requiring outbound?

    Altman's rise shows a story people want to be part of plus a dense network of small favours and one-word introductions generating inbound deals, along with the cost of drifting from the truth.

  • Which of my stories travel, and which only feel like they should?

    Ralston describes Altman telling 'a tale that you want to be part of, that is compelling, and that seems real', which is a reference for what makes a story travel and for how it can mislead.

  • What is the smallest team that can produce at the volume I am used to?

    Altman's 2020 memo argued OpenAI could fulfil its mission with a surprisingly small number of great people, then headcount grew past the cap and culture suffered.

The frameworks

7 frameworks, one animation each

Every framework, step by step

Be number one in four categories

Altman's late 2019 vision memo setting what OpenAI must lead on by the end of 2020

  1. Technical results. Lead on capability, the most important category, because OpenAI needs to build beneficial AGI first or shape its development
  2. Compute. Keep Microsoft close as the supplier of the most powerful supercomputers
  3. Money. Earn enough to buy more compute, making more money in order to do more research
  4. Preparation. Strengthen safety, security and resilience to high-stress situations

From chapter: Part II, pp. 150–234

The data-work crisis playbook

How Scale AI and similar firms built a cheap, disposable global labour pool

  1. Scout. Find places with high education, good internet and economic collapse, so people will work for very little
  2. Attract. Offer high earnings at launch through referral codes, marketing videos and special programmes
  3. Throttle. Cut payouts once the platform dominates the market and competitors have been undercut
  4. Expel. Ban workers who complain or organise, and move to the next economy in crisis

From chapter: Part II, pp. 150–234

Big in scale, tractable, unfairly neglected

Effective altruism's test for picking the highest-priority problems

  1. Big in scale. Pick problems whose solution would have large expected value
  2. Tractable. Pick problems that can be fixed for proportionally little time or money
  3. Unfairly neglected. Pick problems suffering severe, disproportionate underinvestment

From chapter: Part IV, pp. 354–433

Altman's three policy recommendations to Congress

What Altman proposed in May 2023 to shift attention from present harms to future systems

  1. Licensing agency. Create an agency to license models above a threshold of capability
  2. Safety standards. Create a set of standards for measuring dangerous capabilities
  3. Independent audits. Require independent audits to check compliance with those standards

From chapter: Index, pp. 548–619

The formula for empire

Hao's three-ingredient account of how OpenAI's mission consolidates power

  1. Centralise talent. Rally the best people around a grand ambition, as McCarthy did by coining artificial intelligence
  2. Centralise capital and remove roadblocks. Use the mission to justify gathering resources and eliminating regulation, competition and dissent, citing scary rival empires
  3. Keep the mission vague. Leave terms like beneficial and AGI undefined so they can be reinterpreted to direct resources as the centraliser wants

From chapter: Part IV, pp. 354–433

The formula for dissolving empire

Hao's recommendations to redistribute power along three axes

  1. Redistribute knowledge. Fund independent research and evaluators and require companies to disclose training data and technical specifications
  2. Redistribute resources. Make supply chains and training data visible and strengthen labour protections for data workers and all workers whose work is co-opted
  3. Redistribute influence. Teach people how AI works and the worldviews of its builders to counter hype

From chapter: Part IV, pp. 354–433

Working with Tom on this

Tom works with creators and founders one to one, from a single session to a fractional role. Work with Tom

Back to the bookshelf