Empire of AI: "Scale of Ambition", "Ascension", and "Science in Captivity" (Patreon)
Content
"In China, which rivals the US in AI talent, no team of researchers and engineers, no matter how impressive, would get $1 billion, let alone ten times more, to develop a massively expensive technology without an articulated vision of exactly what it would look like and what it would be good for...Not even in Silicon Valley did other companies and investors move until after ChatGPT to funnel unqualified sums into scaling...It was specifically OpenAI, with its billionaire origins, unique ideological bent, and Altman's singular drive, network, and fundraising talent, that created a ripe combination for its particular vision to emerge and take over...In other words, everything OpenAI did was the opposite of inevitable; the explosive global costs of its massive deep learning models, and the perilous race it sparked across the industry to scale such models to planetary limits, could only have ever arisen from the one place it actually did."
so I already was aware of the tech industry's obsession with scale, but I didn't realize the extent to which this was basically OpenAI's whole strategy. It almost feels too easy (and in a way it is, considering all the now obvious problems associated with their quantity over quality approach to data sets/resources required for infinitely increasing compute ), to the point of it being comical to imagine one company trying to hide their 'strategy' from the others, when said 'strategy' is just use MORE. Like I know we make fun of 'line go up' logic, but the more I learn about the inner workings of these companies the more literal a foundational principle that seems to be. I think the irony got a little too much for me at the point where, in a conflict over the API's safety issues vs potential revenue, the resolution was 'if we ignore safety now we'll have EVEN MORE money to invest in safety later!' Has the same energy of ignoring environmental impacts of developing possible future AGI bc it can maybe one day solve climate change.
~~~
A few little observations:
"Working with high-profile institutions would help foster more cooperation between industry and academia for addressing AI safety risks"
This bit had me thinking about the Genesis Mission, which I talked about briefly in the last office hours (Angela Collier has a long video about it ) that's requiring researcher's to partner with AI industry in order to receive federal funding---so far I'd be thinking of this as a way to siphon public funds off to private enterprises, but reading this section made me wonder if it's also trying to siphon off the prestige/credibility of research institutions.
~~~
"Big AI was increasingly going the way of Big Tobacco...distorting and censoring critical scholarship against the interests of the public to escape scrutiny."
The entirety of "Science in Captivity" was really hitting for me because of the research I'm doing rn for my next video. For anyone who was in the Agnotology book club and read the essay on manufacturing doubt about the tobacco industry/SDI/climate change, did the tactics google used to discredit Gebru/Strubell's research feel familiar to you too? I wasn't planning on talking about AI in this and the script is already too long but damn it feels like it's worth a mention now.
~~~
"If GPT-2 fell into the hands of terrorists, dictators, or clickbait farms...the model could be used for notorious purposes."
i just think it's funny that "clickbait farms" are included on the same list of threats as terrorists and dictators. technology's made for a weird world