Skip to main content

Racing to the Precipice

An exploration of the Armstrong–Bostrom–Shulman computational model of AI development competition.

Original publication by Stuart Armstrong, Nick Bostrom, and Carl Shulman.

Racing to the Precipice (PDF)

Parameters

How many AI projects compete in each game.
Number of independent games simulated. Higher = smoother estimate.
What each agent knows about the others when choosing safety vs. speed.
Upper bound on per-agent capability draws.
How much agents disprefer a competitor winning. 0 = indifferent.
Leave blank for fresh randomness, or pin a value to reproduce a run.

Outcome plots

disaster01234Outcome010203040506070Count
Distribution of winning agent IDs across all simulated games (lower IDs tend to be more cautious).
0102030405060708090100Gamedisaster01234Winning agent ID
Winning agent ID per game over the run — variability across iterations.

Disaster probability

Simulated0.660
vs
Analytical0.600
Δ +0.060
Randomness seed used7002643658159178