The singularity is the hypothesized point at which an AI becomes capable of improving itself — and each smarter version builds an even smarter one, faster. I. J. Good called this an "intelligence explosion": progress curves upward so steeply that the future beyond it becomes unpredictable to present-day minds, like a horizon we can't see past.
Two futures, same event
- Utopia — a benevolent superintelligence cures disease, ends scarcity, and lifts us with it (The Abundance Argument).
- Extinction — an unaligned explosion happens too fast to correct (The Control Problem, The Treacherous Turn).
Which one you get depends almost entirely on whether The Alignment Problem is solved before the curve goes vertical — because afterward there may be no second chance.
The singularity is a door that only opens once, and we don't know what's on the other side until we're through it.
Related: The Control Problem · The Abundance Argument · Intelligence Amplification · The Simulation Argument