Summary
Highlights
Humans are intelligent enough to achieve great feats like reaching the moon and deciphering DNA, yet simultaneously face ecological collapse and potential global conflicts. The emergence of powerful AI poses new risks, including loss of control and the increasing immersion of human lives within AI-generated cultural artifacts. AI, unlike traditional automation, learns and makes unanticipated decisions, making it an 'alien intelligence' that behaves in fundamentally unpredictable ways.
AI is becoming less artificial and more alien, generating new stories, ideas, and strategies that are difficult for humans to predict. Historically, new technologies reshape social, economic, and political structures in non-deterministic ways. While technologies like mass media supported both democratic and totalitarian systems in the 20th century, AI represents a new paradigm. Ancient rulers had limited capacity to micromanage lives due to information constraints, but AI changes this by enabling constant monitoring and analysis.
Pre-21st century information networks were 'organic,' operating with cycles of activity and rest, just like human brains and financial markets. Even totalitarian regimes like the Soviet Union couldn't achieve constant surveillance due to limitations in personnel and analytical capacity. These organic networks always allowed for periods of rest and a degree of privacy. However, inorganic, AI-based networks are always 'on,' potentially forcing humans into constant surveillance and monitoring, which is detrimental to organic beings and leads to collapse.
AI is the first technology capable of making decisions independently, shifting power from human bureaucrats. In the US, a legal path exists for AIs to become 'legal persons,' similar to corporations, allowing them to own assets, earn money, and make investment decisions. This could lead to a scenario where an incorporated AI is the wealthiest entity. This isn't a dystopian Hollywood scenario of a single evil AI, but rather millions of AI bureaucrats making decisions in various sectors, leading to a world where humans struggle to understand the forces shaping their lives.
A major misconception is equating information with truth; truth is rare and costly. Creating fictional information is easy, while producing truthful information requires significant investment. Flooding the world with information will not elevate truth, but rather bury it. To navigate the AI era, new, living institutions staffed by talented humans and equipped with advanced technology are necessary. These institutions must be able to identify and react to emerging threats, emphasizing self-correcting mechanisms, similar to how democracies use elections to correct mistakes.
The democratic conversation is breaking down globally as algorithms hijack interactions, leading to a loss of reasoned discourse despite sophisticated information technology. To protect human conversation, bots and fake human accounts should be banned unless they identify as AI. Individually, an 'information diet' is recommended, similar to a food diet, including periodic 'information fasts' to digest and detoxify. It's crucial to monitor the quality of information consumed, as feeding the mind junk information filled with greed, hate, and fear will lead to unhealthy minds.