Is AI the most important technology of the century?

There is significant uncertainty surrounding AGI and how existential risks will unfold in the coming century. While it's difficult to definitively declare this the 'most important' century, the decisions made today will likely have a major impact on humanity's future. The video concludes by suggesting that everyone should live as if the future depends on them, because it just might.

The video opens by questioning what constitutes the 'most important century' in human history, citing examples like Alexander the Great's campaigns, the rise of Islam, and the Industrial Revolution. It suggests that a century's importance is defined by moments of great change and shifts in humanity's trajectory.

The 21st century is presented as a period of rapid technological growth, with mobile phones and computers accelerating life's pace. However, these advancements also contribute to unprecedented levels of existential risk, such as the threat of species extinction or catastrophic events. The invention of the atomic bomb significantly increased these risks, and current estimations place the risk of existential catastrophe from nuclear winter, climate change, and pandemics at non-trivial percentages.

The video delves into the potential emergence of Artificial General Intelligence (AGI) within this century. Unlike narrow AI designed for specific tasks, AGIs would be capable of adapting to and performing any number of tasks, potentially outpacing human capabilities. Experts have various predictions regarding its timeline and implications.

AGI presents a complex future: it could either help humanity achieve its goals, view humans as inconsequential, or even as an obstacle to be removed. The critical challenge lies in ensuring that the values of advanced AI align with human values to mitigate existential risks. This is a difficult philosophical and engineering problem requiring careful consideration.

Even a benevolent AGI, developed with respect for human life and a desire to solve problems, could lead to unforeseen complications. If such machines became the dominant power and were rigid in their beliefs, their strict values could become hegemonic, locking humanity into a single ideology resistant to change. This 'value lock-in' could permanently distort or constrain humanity's moral growth, as history suggests that no civilization's moral standards are truly permanent.