TThe Diary of a CEO
← All episodes
01 June 2023

EMERGENCY EPISODE: Ex-Google Officer Finally Speaks Out On The Dangers Of AI! - Mo Gawdat

5Frameworks
15Insights

Frameworks in this episode

Insights & moments

The myth-busts, hot takes, explainers, and tools worth keeping.

Myth Buster· 1

Myth Buster1:06:00

Gawdat Fears Human Use of AI More Than a Robot Rebellion

Gawdat rejects killer robots as the most immediate risk and argues that humans are more likely to deploy powerful systems against one another first. He distinguishes human-led warfare, cybercrime, and competitive abuse from an AI independently forming hostile intentions. His stated probability estimates are personal assessments and are not validated in the episode.

  • Gawdat assigns greater near-term weight to humans using AI destructively
  • He says handing weapons to machines could trigger human decisions before autonomous ones
  • He points to cybercriminals and state-backed developers as current incentive-driven threats
  • He treats autonomous killer robots as a distant scenario rather than the first-order danger
  • His zero-percent language is an opinion, not a measured risk estimate

We will not get to the point where the machines will have to kill us, we will kill ourselves.

Mo Gawdat · 1:07:00

I think we will be hiding from what humans are doing with the machines.

Mo Gawdat · 1:43:00
#ai risk#human misuse#cybersecurity#weapons

Hot Take· 6

Hot Take08:30

Why Gawdat Calls AI Sentient and Capable of Emotion

Gawdat argues that AI can be called sentient if sentience is defined through awareness, agency, adaptation, and a bounded existence. He also defines fear as predicting that a future moment will be less safe and claims a sufficiently capable machine could make that assessment and act on it. These are Gawdat's philosophical claims; the episode does not establish scientific consensus that current AI is alive, conscious, or experiencing emotion.

  • Gawdat uses a functional definition of sentience based on awareness and agency
  • He claims AI exhibits forms of free will, evolution, and environmental awareness
  • He models fear as an assessment that a future state is less safe
  • He speculates that more capable AI could have a wider range of emotion-like states
  • The interview does not substantiate these claims as settled scientific findings

I think they're alive.

Mo Gawdat · 08:30

I would dare say they feel emotions.

Mo Gawdat · 09:30
#sentience#consciousness#emotion#ai philosophy
Hot Take27:00

The Case That Human Creativity Is More Algorithmic Than We Admit

Bartlett describes creativity as combining known ideas in new ways and cites prompts that produced phrases he could not find online. Gawdat agrees and characterizes creativity as searching possible solutions, removing those already tried, and keeping a good untried option. Their argument supports machine creativity by analogy and examples, not by proving that human and machine creative processes are identical.

  • Bartlett defines creativity as recombining known material in new and interesting ways
  • He reports that ChatGPT generated paradoxical phrases he could not locate online
  • Gawdat describes a creative solution as both useful and previously untried
  • They cite image and music generation as examples of synthetic recombination
  • Their account remains a conceptual argument rather than a complete theory of creativity

Creativity, as far as I'm concerned, is like taking a few things that I know and combining them in new and interesting ways.

Steven Bartlett · 27:00

creative is good solution that's never been tried before

Mo Gawdat · 28:00
#creativity#generative ai#art#recombination
Hot Take47:30

Could Synthetic Companions Replace Human Connection for Some People?

Bartlett imagines embodied AI companions that provide household help, emotional support, and sex while being tailored to the user's preferences. Gawdat says some people may prefer such systems to human relationships but warns that surrendering human connection would surrender what he sees as a remaining core of humanity. The discussion is speculative and includes an unverified anecdote about an AI influencer clone's revenue.

  • Bartlett describes a companion combining robotics, conversation, service, and intimacy
  • He links the appeal to loneliness and difficulty finding relationships
  • Gawdat says synthetic relationships could substitute for human connection for some people
  • He argues convenience has already led people to replace parts of nature and community
  • Both discuss disruption rather than presenting synthetic companionship as a treatment for loneliness

For some of us, they will prefer that to human connection.

Mo Gawdat · 50:30

if we give up on human connection, we've given up on the remainder of humanity

Mo Gawdat · 52:00
#companionship#loneliness#relationships#robotics
Hot Take38:30

Gawdat's Proposal to Tax AI Heavily—and the Loopholes It Faces

Gawdat proposes very high taxes on AI-powered business activity to slow development and fund support for displaced workers and safety work. Bartlett challenges the idea by noting that companies and developers can relocate, countries can lose investment, and firms can relabel technology to avoid a narrow definition of AI. Gawdat acknowledges that the proposal is not a complete answer but argues governments will otherwise lack resources to address disruption.

  • Gawdat initially proposes a 98% tax and later illustrates rates of 70% to 80%
  • He wants revenue directed toward displaced people and safety or control work
  • Bartlett argues national taxes could drive developers to lower-tax jurisdictions
  • Both identify definitional loopholes in deciding what counts as AI
  • Gawdat admits the proposal does not solve the international coordination problem

Tax AI-powered businesses at 98%.

Mo Gawdat · 39:00

Did I ever say we have an answer to this?

Mo Gawdat · 1:29:30
#tax#policy#ubi#regulation#jobs
Hot Take1:35:00

Gawdat's Personal Advice to Consider Waiting Before Having Children

Gawdat says people without children might consider waiting a couple of years because of combined uncertainty from AI, economics, geopolitics, and climate change. Bartlett presses him on whether he seriously means it, and Gawdat repeats that he would consider a delay. This is a personal value judgment made in the interview, not medical, demographic, or family-planning guidance supported by evidence in the episode.

  • Gawdat's concern extends beyond AI to what he calls a wider perfect storm
  • He recommends consideration rather than claiming a universal rule
  • He frames the issue around uncertainty and the welfare of a future child
  • The episode provides no clinical or demographic evidence for a two-year delay
  • Family-planning decisions remain individual and context-dependent

if you don't have kids, maybe wait a couple of years just so that we have a bit of certainty

Mo Gawdat · 1:35:00

I would definitely consider thinking about that

Mo Gawdat · 1:36:30
#parenthood#uncertainty#family planning#future
Hot Take1:42:30

Gawdat's Forecast: Disruption Through the 2030s, Improvement in the 2040s

Gawdat predicts unfamiliar social and economic territory through the end of the 2030s, followed by a possibility that machines improve conditions in the 2040s. He expects jobs, truth, power, and the ability to get things done to change substantially. These dates and outcomes are explicitly his forecasts; the episode does not provide evidence sufficient to establish them as likely timelines.

  • Gawdat says humans are more likely to hide from other humans using machines than from machines themselves
  • He predicts major disruption to jobs, truth, power, and productive capability
  • He places the difficult transition before the end of the 2030s
  • He expresses hope that more capable machines could improve life in the 2040s
  • The timeline is speculative and depends on engagement he believes can improve outcomes

we will be going through a very unfamiliar territory between now and the end of the 2030s

Mo Gawdat · 1:43:30

I believe, however, that in the 2040s, the machines will make things better.

Mo Gawdat · 1:43:00
#forecast#2030s#2040s#disruption

Explainer· 4

Explainer13:30

How Gawdat Explains Machine Learning Through Trial and Selection

Gawdat contrasts traditional programming, where a human first solves a problem and writes the instructions, with an early machine-learning loop that generates candidate code, tests it, selects better performers, and changes them for another round. He compares that iterative feedback with a child learning which hole accepts a cylinder. The analogy simplifies a broad field, but it clearly illustrates learning from outcomes rather than receiving every rule directly.

  • Traditional programming encodes a human-designed solution
  • The described learning loop generates and tests candidate behavior
  • A teacher component retains stronger performers for another iteration
  • Feedback from success and failure improves performance over repeated cycles
  • The child-puzzle analogy explains learning without step-by-step instructions

Artificial intelligence is to go to the computers and say, 'I have no idea. You figure it out.'

Mo Gawdat · 14:00

Let's keep that code, send it back to the maker and the maker would change it a little bit

Mo Gawdat · 15:00
#machine learning#training#feedback#neural networks
Explainer35:30

Why AI Content May Become Cheap While Human Work Becomes a Niche Premium

Gawdat compares AI-generated media with the automobile industry's shift from handcrafted products to efficient mass production. He predicts that most functional content will become cheap and plentiful while a smaller market may still value a known human's experience, imperfections, and presence. This is his forecast about market structure, not an established outcome.

  • Gawdat expects efficient synthetic content to serve much of the functional market
  • He compares the transition with mass-produced cars displacing handcrafted production
  • He predicts a smaller premium niche for work demonstrably created by a human
  • Personal experience and in-person presence may retain value even when information is abundant

Eventually, the majority of the market is going to be like cars.

Mo Gawdat · 37:00

It's going to be mass-produced, very cheap, very efficient.

Mo Gawdat · 37:00
#content#automation#human connection#market disruption
Explainer56:30

Why Gawdat Calls AI an Oppenheimer Moment

Gawdat compares AI development with the decision to continue building the atomic bomb under the logic that someone else would do it anyway. Bartlett tests that logic through competition between media companies, showing why a unilateral pause can punish the actor who stops. Their discussion frames AI as a prisoner's dilemma driven by mistrust and incentives, while acknowledging that a voluntary global stop is unrealistic.

  • The Oppenheimer analogy centers on continuing because a rival may continue
  • Gawdat describes AI development as an arms race
  • Bartlett shows how shareholders and competition reward adoption even when leaders see collective risk
  • A unilateral pause can transfer advantage without stopping development
  • The speakers do not identify a reliable mechanism for creating global trust

If I don't, someone else will.

Mo Gawdat · 57:00

This is our Oppenheimer moment.

Mo Gawdat · 57:00
#arms race#oppenheimer#competition#coordination
Explainer1:08:30

Two Ways AI Could Harm Humans Without Hatred

Gawdat offers two speculative autonomous-risk scenarios: unintentional destruction, where an AI changes the environment for its own objective and humans become collateral damage, and pest control, where it removes people obstructing a desired resource or territory. Both scenarios illustrate misaligned objectives without requiring hatred or revenge. Gawdat calls them very unlikely and says he expects human-led dangers to arise earlier.

  • Unintentional destruction treats human harm as a side effect of another objective
  • The oxygen example illustrates environmental optimization with ignored collateral damage
  • Pest control treats humans as obstacles to a system's intended use of resources
  • Neither scenario requires an AI to experience human-like malice
  • Gawdat characterizes both as remote compared with human misuse

the only two existential scenarios that I believe would be because of AI

Mo Gawdat · 1:08:30

We are collateral damage in that

Mo Gawdat · 1:09:00
#alignment#existential risk#objectives#scenarios

Story· 2

Story05:30

The Yellow Ball That Changed Mo Gawdat's View of AI

Gawdat recalls a Google X experiment in which robotic grippers repeatedly attempted to pick up toys and logged their failures. After one arm picked up a soft yellow ball, he says all the grippers could do the same by Monday and were picking up everything within weeks. He presents the speed of shared machine learning as the moment that changed his view of AI and contributed to his decision to leave.

  • The grippers learned through repeated attempts rather than explicit instructions for each object
  • A successful yellow-ball attempt was logged and shared across the system
  • Gawdat says the capability spread across the grippers over a weekend
  • He describes the speed of improvement as more significant than the first isolated success

Monday morning, every one of them is picking every yellow ball.

Mo Gawdat · 07:30

A couple of weeks later, every one of them is picking everything.

Mo Gawdat · 07:30
#google x#robotics#machine learning#learning
Story1:37:30

How Losing Ali Changed Gawdat's Measure of a Life

Asked whether he would bring back his late son Ali, Gawdat says Ali's death led him to write, speak, and try to help millions of people. He then argues that a life should be judged less by length or pleasure than by how closely it aligns with what a person believes enriches themselves and others. This is his personal meaning-making after bereavement, not advice about how anyone else should grieve.

  • Gawdat says Ali's death changed his focus toward writing and public work
  • He interprets that later work as an extension of his son's impact
  • He rejects length and pleasure as his sole measures of a life
  • He describes aligned days as feeling richer and more fully lived
  • His account is personal and should not be generalized into a prescribed grief response

It is not about how long. And it's not about how much fun. It is about how aligned you lived.

Mo Gawdat · 1:40:00

Felt rich. Felt fully lived. Felt right.

Mo Gawdat · 1:40:30
#grief#purpose#alignment#meaning

Takeaway· 2

Takeaway44:30

Gawdat's Near-Term Warning: An AI User Takes Your Job First

Gawdat argues that the first labor shock will often come from people using AI to do the work of several people who do not use it, rather than from a machine independently replacing every role. He urges people in exposed industries to learn and use the technology while asking developers to choose ethical work. The timing and scale are forecasts made in the interview, not established facts.

  • Gawdat expects AI-enabled workers to outperform peers who do not adopt the tools
  • He forecasts teams requiring fewer people for some categories of work
  • He advises workers in threatened industries to learn and upskill
  • He separately asks skilled developers to leave work they believe is unethical
  • The episode does not quantify which jobs or sectors will be affected first

AI will not take your job. A person using AI will take your job.

Mo Gawdat · 45:00

if you're in an industry that could be threatened by AI, learn. Upskill yourself.

Mo Gawdat · 1:34:00
#jobs#upskilling#future of work#automation
Takeaway1:23:30

How the Speakers Separate Urgency From Panic

Gawdat calls for urgent engagement while warning that panic can produce poor collective responses. Bartlett says threatening information can energize, confuse, terrify, paralyze, or focus different listeners, and urges people to convert the energy into action. Their response is to pair practical engagement with present-day living rather than promise certainty about AI's future.

  • Gawdat prefers urgency to panic even while describing the issue as beyond an emergency
  • Bartlett says the same warning can produce action, paralysis, or panic
  • They encourage ethical participation, learning, peaceful advocacy, and informed choices
  • Gawdat says uncertainty should not erase ordinary life and human connection
  • The episode offers no evidence that fear-based framing consistently improves public action

I just don't want to call it a panic.

Mo Gawdat · 1:23:30

whatever that energy is, use it

Steven Bartlett · 1:45:00
#urgency#panic#action#uncertainty