The Dark Side of the Web

The internet's growth in the 1990s led to instant communication, but also raised privacy concerns. The US Naval Research Laboratory (NRL) developed onion routing to enable anonymous, bi-directional communication, preventing source and destination from being traced. This technology created an 'overlay network' (darknet) on top of the internet, accessible only with specific software.

The NRL realized that for anonymity to be effective, the system had to be widely used, not just by the US government. They released onion routing technology to the public as open-source software, which became 'TOR' (The Onion Router). Millions worldwide now use TOR for various purposes, from daily browsing to criminal activities.

The dark web is a small part of the deep web. The deep web encompasses all content not indexed by search engines, including online banking, Netflix, and password-protected pages, making up the vast majority of the internet. The surface web is content easily discoverable by search engines. The dark web consists of darknets accessible only through specific software like TOR.

The dark web primarily consists of 'hidden services,' websites only accessible via TOR and ending in '.onion'. While some legitimate services like Facebook have hidden presences, the dark web is notorious for illicit activities. Examples include online drug marketplaces like Silk Road, murder-for-hire services (often scams), and highly disturbing content such as child pornography.

Despite sensational media portrayals, the dark web is not as extensive a criminal underground as often believed. A 2016 study found that roughly half of active .onion websites contain illicit content. However, only 3-6% of all TOR users actually access these hidden services; the majority use TOR for anonymous browsing of the surface web to protect their privacy.

Preventing criminals from using anonymous services while allowing lawful citizens to protect their privacy is a dilemma. TOR's inherent design for unrestricted anonymity means 'you don't' restrict it. The US government, despite the dark web's criminal elements, continues to fund the TOR project because widespread public usage is crucial for the anonymity it offers, which they themselves require for agents operating undercover.