“It’s the first thing I read every morning.” — Philip Howard, Common Good.
1. Anthropic has officially filed the prospectus for its initial public offering, which means the AI lab has put all kinds of formerly private information on display. While the prospectus contains the eye-popping revenue—and even larger expenditures—you might expect, the biggest section of the filing by far is given over to “risk factors,” which are all the things that could squash Anthropic’s big plans. Or, in this case, humanity itself. While much has been made about the extent to which AI represents an existential threat to humankind, the specific mechanisms by which it could bring about that destruction are largely opaque. If nothing else, the 94 pages that Anthropic’s prospectus devotes to risk factors make clear both where it sees the danger coming from, and the ways in which its researchers are running toward it in order to win the AI arms race. “Sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight and security measures, pose catastrophic or existential risks to humanity,” the prospectus reads, citing concerns both from critics and regulators and from inside Anthropic itself. (It’s the first of three times the phrase “existential risks” pops up.) (Source: wired.com)
2. From the S-1:
(W)ith the scale of harm that could result from a catastrophic AI-related incident, no single insurer, and potentially the insurance industry in the aggregate, may have sufficient capacity or expertise to underwrite insurance commensurate with such exposure.” (Source: bloomberg.com)
3. Tyler Cowen:
Throughout the tech industry, there is a slowly rising worry about AI breakthroughs in cryptography, which, in theory, could throw open the front door of every email, online transaction, and bank account.
Recent headlines tell the story. “Vitalik Buterin Warns AI Could Break Lattice Cryptography Within Two Years,” reads one, announcing that the cryptocurrency creator has lost faith in systems recently thought to be invulnerable. Even more daunting: “Claude AI Solves 25-Year NSA Cryptography Mystery in Just 30 Minutes.” Now that an AI model from Anthropic (where I am an economic adviser) has cracked through a barrier no human has managed, whether any barrier is safe has become a live question. (Source: thefp.com)
