“AI Snake Oil” Chapter 4: “The Long Road to Generative AI” (Patreon)
Content
Besides the story of the law professor who was falsely accused of sexually harassing a student by a chatGPT-generated news articles (which was wild, I hadn’t imagined personal level libel like that being a possible outcome of LLM hallucinations), I’d already learned most of the information here on gen AI while researching my video. I’m also pretty familiar with most of the technical explanations from when I had to learn machine learning for astrophysics stuff, so not the most exciting chapter for me. BUT something I did find interesting was the evolution of the culture around AI development. These passages stood out especially:
The data annotators on Amazon Mechanical Turk were typically paid low wages… Further, ImageNet developers did not compensate the photographers who created the images...ImageNet operated on a small budget and might not have existed if not for this way of gathering and annotating data. But even today, commercial projects by trillion-dollar companies operate the same way.
ImageNet continued the culture of open knowledge sharing in AI research. It was a great demonstration of how quickly progress could happen if researchers built on each other's work. Even though many of the contestants worked for companies who were in competition with each other, the norm of openness held sway…Today, this culture has changed to some extent as companies prioritize profits.
I guess I shouldn’t be surprised that the AI industry retained the early norm that saved money but is almost inevitably exploitative at scale, and abandoned the norm that was collectively beneficial but a liability in economic competition. At first that makes me feel kinda hopeless, like of course the industry will develop in the most capitalistic way possible as the technology becomes more economically viable and useful to whatever kinds of power, and it’ll probably only get worse. BUT, one of the silver linings of all the mostly depressing research I did was learning about the little bits of resistance to these trends. E.g., I mentioned about Turkopticon.net in the video, which is at least challenging the annotating data part of the first trend. And I didn’t talk about this in the video, but there are some companies/orgs that are really focused on maintaining the open-source ethos of the earlier industry, like Hugging Face (which is where I got a lot of the data on open source models energy use in the absence of data from the big AI companies, and is also the place Jordan recommended for people who want to locally host an LLM). Basically, the overall trend is upsetting, but the ways in which some people in/around the industry are pushing back on it is somewhat hope-inducing for me. I guess that’s one of the other advantages about learning about AI, just psychologically—yeah there’s a lot of doom, but there’s also all the ways people are trying to respond to it, and it’s nice to know that instead of just imagining the industry as this ambiguous blob of uniform evilness.
Completely unrelatedly, I was shook by this passage:
We think fears about vote manipulation are vastly overblown. Evidence suggests that people are naturally skeptical of what they see online and are resistant to persuasion. If anything, the problem is the opposite.” The fact that just about anything online may have been AI-generated means that the internet will be seen as even less trustworthy.
…really? I don’t have a citation or anything (they didn’t either i guess) but this feels like the opposite of true. I mean, I agree that the internet will be seen as less trustworthy, but I don’t know if that translates to misinformation not being effective. This feels kinda like their statement from chapter 1(?) about AI not really making education any worse/harder—ie, weirdly confident for how completely against my intuition it seems to be. Idk, what did yall think about this bit?
On a forward looking note, I’m really looking forward to reading the chapter on collective action and advocating for regulation they teased a few times in this chapter—I had my own take on it from the video ofc but I imagine the authors will have more of an inside perspective that I’m very curious to hear.