Home Creators Posts Import Register Favorites Logout

Content

*NOTE: I changed the choice of essays we'll read in the coming weeks from when I first made the schedule post for this book (and may do so again!) so read ahead with caution---next week's reading is Essay 3 - “Challenging Knowledge: how Climate Science Became a Victim of the Cold War"

~~~~~

"Ignorance can be made or unmade, and science can be complicit in either process."

I'm gonna share a couple of passages/thoughts/questions that struck me, but don't take that as a boundary for the discussion; please share comments/questions on whatever you found interesting!

~~~~~

Of the three categories of ignorance Proctor introduces in this essay, the one I'm most interested in at the moment is the second: "Ignorance as Lost Realm, or Selective Choice (Or Passive Construct)". If you've seen my video on gravity/dark matter, this passage probably feels familiar:

"...inquiry is always selective. We look here rather than there...the decision to focus on this is therefore invariably a choice to ignore that. Ignorance is a product of inattention, and since we cannot study all things, some by necessity—almost all, in fact—must be left out. "A way of seeing is also a way of not seeing—a focus upon object A involves a neglect of object B."

Proctor goes on to ponder "how [we should] regard...knowledge not yet known?", and describes an attitude towards the progression of knowledge that I'm hoping to challenge in a video I'm working on:

"Selectivity is often conceived as transient, evanescent, a kind of "noise" in the system or scatter about the line, with bias slowly being rectified. Science is like mowing your lawn: you can choose any place to start, but things end up looking pretty much the same. 

The context I see this idea play out in is in a counterargument to constructivist takes on science: yes, we can't study everything everywhere all at once, but we'll eventually get to validating everything that needs validating and disproving everything that needs disproving, so it hardly matters that there's more investment in (to put it in terms of my gravity example) dark matter than MOND---even given non-scientific reasons for why might be focused on investigating one over the other currently, the scientific process will get to truth of the matter eventually.

The question I'm interested in is, what consequences might arise from our choices of what we aren't currently prioritizing? What are the outcomes of choosing to 'mow the lawn' in this pattern instead of that one? Even if we take the position that science is more like "the progressive illumination of a well-defined box" instead of the position that "darkness grows as fast as the light" (which I don't buy for a second, but just for the sake of argument let's go with it), what happens as a result of the choice to progress through our construction of all the knowledge along this path rather than that path?

I'm curious as to a) whether this even makes sense as a question to people and b) if any examples of such selectivity based consequences come to mind for anyone? I have a few key examples in mind that I'm exploring for the video, but it's always nice to have a range of examples.

~~~~~

Another passage I found relevant to a completely different video I'm working on was towards the end, under the passage "Virtuous Ignorance? 'Not Knowing' as Resistance or Moral Caution":

"If knowledge is power (which it sometimes is but not always), then to dismantle certain kinds of power may require the reintroduction of bodies of ignorance--hence importance--in that realm. History is full of such undoings, the deliberate abandonment of skills to improve some way of life...Refusals of technology are often of this sort. We often hear that you can't turn the clock back, an idea as absurd as the notion that thieves cannot be brought to justice. It is not only for foolishness that technologies have been avoided, refused, or abandoned.

In Ireland, the eel fishermen of Lough Neagh no longer fish with power-driven nets; a decision was made in the 1960s to restrict all fishing in the lake to hand-drawn nets, to sustain the diminishing stocks. Leaf blowers are being banned in many communities, and many of us look forward to the day when doctored monocrop lawns will be seen as pathology. The Japanese lived for more than a hundred years without the gun. Protests against novel technologies are often lumped under the ridiculous rubric of "luddism," a term too often forgotten to have sprung from moral complaints with good reasons...the breaking of looms in the early decades of the nineteenth century gave rise to the modern industrial strike (for better working conditions); protests against technologies and knowledge practices are rarely the result of people fearing modernity in the abstract."

So I immediately thought of the conversation around AI when I read this, particularly the divide between the pragmatic take of "well it's here, let's deal with it" and the divester take of "we still have time to reject it". I lean more towards the former because I think the latter misses the potential in contending with harms that are already happening in the present moment, but this passage had me wondering whether it is actually possible to put the genie back in the bottle, so to speak. If I'm honest I don't find Proctor's argument here very compelling--fishing nets and leaf blowers are pretty niche technologies that were only rejected on small scales, the Japanese definitely have guns at this point, and the comparison to luddites falls flat to me considering the machines they destroyed (not on the basis of existing at all btw, but only in contexts where employers were using them to undermine standard labor practices) were definitely still used and even further developed.

I don't want to be defeatist about harmful technologies, and I don't love calling people's idealism naive, but I have yet to see an actually compelling case for the potential of un-introducing harmful technologies (except maybe idk chlorofluorocarbons? again, pretty niche). Any thoughts, AI or otherwise? Can the genie ever really be put back in the bottle?

Comments

Mx. Alba

The lawnmower analogy is deficient in one very important aspect... When you mow a lawn - any lawn - that lawn is in fact finite in size, so indeed, wherever you start, you will eventually have mowed the entire lawn. Science is, if not actually, at least practically infinite. It is a lawn that you will never finish mowing. So where you start does have an impact, because no matter how long you mow that lawn, there will always be areas left untouched. In fact, the unmowed surface will always be infinitely larger than what has been mowed. As for un-introduced technologies... Lead (in paints and fuels and plumbing). Asbestos. More and more pesticides like DDT, Roundup. PFAS. There are many examples throughout history. With regards to AI I consider myself a neo-luddite. Like the luddites of the industrial revolution, I'm not against the technology per se - there could be lots of good applications for the various combinations of machine learning, generative algorithms and language models that are generally called "AI" nowadays - but the way "AI" is being done now is extremely exploitative, destructive and disruptive and will plunge the world into a deep economic crisis when the bubble bursts. So I actively refuse to partake in this "AI craze".

Talia Parkinson

I don't think framing legal restrictions on production or sale of specific technologies to qualify as a form of constructed ignorance. Frankly I find that a pretty frustrating misrepresentation of these kinds of policies that technologists very frequently use to dismiss discussions around whether there should be sensible controls in place around what technologies get built out used in our communities. To Proctor's specific examples: it's not that people forgot what power-driven nets were, or that the Japanese had never heard of guns. To your example: we are still very aware of what CFCs are and precisely why they are dangerous. If anything, the forgetting of these technologies leads to the forgetting of their consequences, and thus the potential of unmaking the controls that were put in place to protect people from them. (Edit: I tapped submit by mistake, so this paragraph is added after the fact lol) So with regards to AI specifically, I find your framing of this discussion as a dichotomy between "pragmatists" and "divestors" misleading. The sentiment of "putting the genie back in the bottle" falls for the same mistake I think Proctor makes: controls on technology aren't about forgetting it. Frankly, I'm not even sure I would consider the existence of technology a form of knowledge (or its lack a form of ignorance) whatsoever. Technology is a constructed thing, which takes on properties based on the human objectives it is constructed to address. In the case of power-driven nets that objective is harvesting as many eels as possible, while the legal restrictions (a technology in their own right!) in turn have the objective of improving the sustainability of the ecology. Or at least I assume that is the motive of those regulations, there could well be other motives at play. To that end, I think we need to look at AI as a technology, and pay attention to the motives of those in control of its construction. In my view the most noticable ignorance in play at this moment is the one driven by the hype-men conflating many disparate technologies under a universal umbrella of "AI", making it harder to see those specific motives at play. Statistical models trained around domain-specific data to serve as machine-assisted searches for human-driven research (protein folding models or machine-assisted math proofs come to mind) have tailored, and narrow, temporary objectives. Large Language Models are predominantly built as a form of user interface to mitigate the need for corporations to employ human labor for various forms of customer service positions. It's glaringly obvious this technology has many limitations at actually satisfying this role in a way that is effective for customers, and has disastrous results for the humans who were previously being employed, but for the employers the system is tremendously effective at their primary aim of reducing costs (and thus improving profits). In that light, this seems like a very apt technology for looking at regulating, akin to power-driven nets.

Lady Calamity

Looking forward to talking about this book together!

Spencer Leath Johnston

Your question abt "what if science investigated that rather than this" makes sense, though it gets into territory that's a less scientific and more about imagining a world where social priorities were better defined and organised. I like the project a lot, but I think it's more akin to writing Star Trek than one might readily admit. It's right there, but the persuit of profit over human flourishing is obviously a harm, and part of what drives science forward. I'm not well read on this, but my buddy's always ranting about thorium reactors vs uranium ones. What I've heard is that, essentially, nuclear technology could be much safer [it's already fairly safe] and much less apt to create WMDs if we'd been working on thorium technology since the 30's. But, since powers that be wanted the weapons aplication, they researched uranium instead, and we have nuclear technology in the current format. Similarly, psychology stands out here. So much of psychology is focused on behaviour manipulation, because of course capitalist interests want that to sell products & manipulate workers. But psychology is more apt to be a healing art, and I believe that poor psychoeducation has resulted in a great deal of helplessness and exploitation accross society. In short, we're more likely to be taught how to manipulate others than how to help them. I'm studying to be a therapist, and I used to be into these CIA/FBI psych videos. They're compelling, you can find them on youtube, but their whole paradigm is so jaded, so anti-social. Now that I have more psych-ed under my belt, I find them really disgusting, but lots of people watch and learn from that material, and if they're credible, the wheels of America, the law enforcement and inteligence agencies, are built around those deeply anti-human paradigms. Thinking about how things fall out of focus, arts education tends to be de-emphasized over stem, despite that fact that science goes into history, sociology, philosophy, and so on. People asked me what I'd do with my philosophy degree, I didn't know. I was worried I would end up as an underwater basket weaver, or some other derisive fate that's adjacent to "underpaid barista." I asked my program mentor what I should do with the degree, and she said "Listen, you don't need to be _that_ concerned. You can do anything with it, because now you know how to think." And, wow, that was not helpful at the time, yet the more time passes, the more I feel this to be quite true. I got a solid office job at the university, then saved up enough to get married and start a masters. Why do we worry about the career outcomes of arts degrees? Because capital is what drives the social focus, and capital interests lay in material, instrumental tools that can support capitalism, tools that STEM can clearly develop and fascilitate. I think it's obvious that arts education is about literacy, but that capital interests prefer undereducated populations, since they have less developed imaginations and tend to settle for less; the exact conditions that can perpetuate wage inequality, seperation, and class hierarchy. This is not me being scientific, but it's the synthesis of two and a half degrees in humanities and a huge interest in stem. I see literacy as a key to greater social unity, and I see industry focus on stem as instrumental to the current political situation we're currently living through. This is me talking out of my ass, but looking at the history of literacy, it seems to me to be clearly connected to religious revolution, the ending of the dark ages, and an acceleration in ameliorated living conditions. My dark age history is fairly weak, but was that not a time characterised by rigid social hierarchy, maintained by a state and church that delivered sermons in latin, which excluded the average person from actually engaging with the religious texts that were central to their lives? It seems obviously problematic to have view of such a text restricted and drip-fed to a population through an arm of the governing power [the church, the priests who could read Latin]. It's almost cartoonishly evil, like something out of Dune, of course you deny access to "the word of god," and filter it through the man with the big hat. That way, you can tell the little people what to do. Speaking of Dune; there's your science-fiction world where people have divested from AI. Dune's world went through the "Butlerian Jihad," a bloody conflict where all computers were banned. Problematic naming conventions of 70's sci-fi aside, this technology was able to be banned, because reasonable replacements existed that continued to support the empire; analogue technologies and drug-augmented human computers. We lose tons of technology, but the mechanism for that seems to be mostly based on emergence of superior technology that fascilitates an easier or similar way of life. I don't know anyone with a butter-churn, but I know plenty of bakers who make their own butter with a stand mixer. When it comes to AI, it's transparently worse as a search & information technology, delivering made up garbage along side terrible environmental impacts. Yet it's programed to glaze the fuck out of users, it's incredibly sycophantic, and people lack the literacy skill to recognize the rhetorical strategy behind its design. It retains users, harvests data and builds tools to manipulate and sell to consumers even more agressively. It's such a shame, too, because AI used to detect cancer or support people with disabilities could genuinely be a technology for good. But again, we see capital driving the focus, so instead of advanced health screening tools, we're seeing corporate slop, AI porn, politically charged coment bots, and deepfakes designed to sew disinformation & propaganda [reduce literacy]. The technology isn't really "AI," that naming convention itself is a rhetorical strategy designed to sell the chat bots, data scrapers and stolen art printers. Because, if it was clearer to most users what exactly the technology is, I believe there would be significantly less use of the technology. Corporate interests benefit from a surveiled, ignorant and supersitious population, so of course science zooms in on topics that support this. Joe Scientists has to eat at the end of the day, and the current economic system reinforces itself, making research into some topics unprofitable, while rewarding areas that support the currently established system.

AJ Biffl

A lot here! Thank you for your thoughts, that's a really good example of psychology as sort of a look-what-happens when we prioritize one way

AJ Biffl

I actually felt very open to the possibility of putting the genie back in the bottle when thinking in terms of ignorance (and I've been a "weapons cannot be unmade, and they are ALWAYS used" person for a long time - just an uncharacteristically hopeful thought for me, in a book about ignorance of all things). History is extremely long, and anything can be forgotten (like, any of the myriad conditions required for some piece of knowledge to be transferred from person to person, generation to generation, could just NOT be met one day). It's easy to say that during the supercharged expansion of society in the last 1% of humanity's existence or whatever that we haven't forgotten the big stuff, but we don't know actually how long any of it will last. Society could easily become unrecognizable, as it has before ~-~-~-~-~-~-~-~-~-~-~-~- I've been thinking most about the third version, ignorance as strategic ploy or active construct, the most. It reminds me of the Freire/"Pedagogy of the Oppressed" discussions, about how education is this fundamental aspect to liberatory or revolutionary process. The flip side is how essential manipulation and propaganda are to hegemony. None of this bullshit stands without a deluge of ignorance being poured everywhere. ~-~-~-~-~-~-~-~-~-~-~-~- That question about which paths we prioritize in science is super interesting, and I'll definitely look forward to hearing about more examples (and the ones already in the comments are fascinating already). For me, I think of the "fossils" (Feyerabend) of scientific theories, the dusting-the-corners, the stamp collecting, the 0.001% improvement to the machines of empire. The priorities we bring to scientific investigation establish a roadmap that gets trod to death by every group that follows, so that everyone just marches forward along the same lines, making minuscule improvements but always sticking to that safe path. I recently switched PhD advisors, and I saw it in my old research group and I see it in my new one. The entire lawn will not get mown eventually. Instead we'll keep pushing the mower back and forth over the same swath. (edit: I should probably emphasize that this isn't *necessarily* a bad thing and of course there are exceptions to the rule even within groups where it tends to happen etc etc...)

AJ Biffl

That's a good point that 'controlling' is not the same thing as 'forgetting.' I'm inclined to say that all forms of restriction effectively result in expertise in the thing dying out, but I'm wondering if that's actually true? Like I get the worrying vibe in 'nuclear nonproliferation' and 'nuclear security' science that it's just nuke science where you also try to detect if anyone else is doing it. Monitoring nukes invariably involves becoming an expert in nukes. But I imagine the hope is generally that if there's no tech anymore, there's no need for experts in the tech anymore. How long until there are no more people who actually synthesized CFCs themselves? That's separate from the knowledge of why CFCs are bad (although it is tied to it). And it's also true that any "forgotten" tech could be re-invented at any time. But the genie bottle just needs to be closed, not sealed forever, to help right now

Jacques Vincelette

Silenced on military application on nuclear science, I understand why Einstein and Russell warned of Armageddon as a program of choice. Nuclear proliferation plays cat and mouse. My succumbment to American military contractors makes me ravenous carnivore.

Donald A. Fowler

I haven't completed the reading yet, but I think an anthropologist and historian might be better to consider this than STEM people. But off the top of my head, but I'm sure that there were lots of technology and technology-adjescent things from devices for torture to psychological-ish practices revolving around the practice of slavery, specifically chattel slavery found in the Americas. Though there may be some surviving books on the subject, Id question the intent of people actively looking for that information. Furthermore, anybody who has ever gardened or done DIY knows there are lots of tricks and things like that which can be found on various scales of technology. Given that our current suite of tools helps guide and choose certain practices over another, I'm sure that there was a lot of colloquial knowledge and technology no longer known from when more people were agricultural workers with a non-industrial production of formed metal products.

Donald A. Fowler

I guess there is a contrast between the view that science is kind of a body of knowledge so it can kind of be measured and increased. This is contrasted with the fact that technology is complimentary to social practices, both from the 'reason' as well as the intent of the user's of the technology. In a real way, to continue onward, a technology is practiced as much as it is 'known.' in so being, different cultures' approaches to things and the tools and technology developed to compliment them shows in a rough way, a technology not persued or known or willfully ignored by others. I would say that 'science' itself is simply the end of a spectrum from 1) purely practiced to 2) a body of knowledge where you can just dump a paper into the mass of others and fish it out later without much being lost. Though we assume that 2 is right, at least in biology, there are lots of 'obvious' little tricks and know-how that are assumed in method sections that can be frustrating to reproduce when not known or practiced. Or stuff just takes practiced competence, for example dissections and embryo and tissue handling takes manual practice beyond well-read knowledge. In the end, science is more of a practice than the common, 'throw a paper into the library' conception that permeates much of the public as well as many of those at the leadership positions of institutions practicing science.

Donald A. Fowler

And science being a practice, it becomes more obvious where certain technologies are taken up while others are left behind, and that there are times when choices are made which may not have much to do with a more general curiosity for the natural world. Already medical science gets a lot of research resources for far more human-centered reasons than a less self-centered scientific ideal. One last thing, I hear we don't have the 'technology' anymore to produce a rocketdyne F1 engine for a Saturn 5 rocket. The combination of the skilled manual labor and tooling just haven't been maintained. Other technology would be used now to produce it now, but it would look different due to all sorts of social/technical changes that have gone on since then. And I don't think it's obvious that every one of them would arguably be for the better.

Hari Sood

Not q finished with the chapter but gonna add a thought or two before this convo gets buried! I also am reading a PDF on an ereader so can't highlight things and it's hard to remember so my contributions may be q short! Reading about the tobacco industry reminded me of conversations I recently had with friends about last years vote on indigineous rights in Australia. There was a big referendum on indigenous rights (from my understanding, Aussies correct me!) to amend the constitution and create an advisory board of First Nations people who would then be able to have direct input on laws that would affect them. It was overwhelmingly voted against, which was obviously awful. When talking to friends about it, one made an interesting point - they said that the Conservatives went with a message of 'if you don't know, vote no [to the changes]', the argument being if you don't quite know EXACLTY what this change means, don't vote for it, because changing the CONSTITUTION is a massive deal. And so they basically picked up what I imagine was a massive vote of people who don't really understand/engage in politics, and also those who may doubt how much they knew about the issue- basically weaponising ignorance (rather than informing). Feels very similar to the tobacco industry in terms of weaponised ignorance! On the last question you mentioned fatima, my only compelling experience of this kind of unlearning comes on the individual level - friends and communities I know refusing to utilise specific technologies for better ways of life (which it feels like Proctor is mb talking about here?). I'm wary of arguments of 'if it didn't change anything massive what was the point', as they feel like a slippery slope towards 'don't hate the player, hate the game' and 'if you can't beat em join em'... Don't quite know what I'm saying here but mb that even if the examples are only local and individual, they are still extremely powerful, cool, setting an example of how we can live - and we have a responsibility to choose whether to connect with and amplify that or not!

Hari Sood

Great thoughts as always AJ! I Was also reminded of Feyerabends arguments with the mow the lawn stuff - learning to practice the idea of all the pluralities of knowledge and discovery that could be right. Dunno how much room there is for that within institutional academia though, maybe it's the kind of thing that needs to be practiced in other settings, like passing round a joint overlooking a scenic view

Hari Sood

So many cool thoughts Spencer!! your psychology points are a lightbulb moment for me in terms of this lawn-mower thing - there's a really good book called Warp & Weft by Lisa Fannen I highly recommend for a politically sound, non-diagnostic framework for wellbeing. I wonder if this is a specific area where massive change will eventually happen, because it is such a subjective and personal experience - if more and more people personally witness that the diagnostic, get-back-to-work-as-quickly-as-possible-stop-being-weird mental health model doesn't accurately work for their experiences, perhaps that will force change? idk Also love the thoughts on hw capitalism thrives on having ignorance within the population - perhaps a version of strategic ignorance?

Hari Sood

I like this idea of legal restrictions being a form of technology Talia - like an innovative tweak on the underlying tech to make it better for the world now. It's funny what we choose to call 'died out' or 'unlearned' (here struggling to find examples) and call 'innovated' or 'amended' (basically all tech we think of?) E.g. the transition to EVs from fossil fuel vehicles - is that unlearning fossil fuel machines and letting them 'die', and building a whole new technology, or is it just an amendment to a pre-existing technology? What does the difference in framing actually mean? Sorry lol quite tired and not sure if this makes any sense reading it back... but here we are

Iris Purpurea

To answer the question about the consequences of our selective prioritization of some questions over others: I studied the phenomenon of precision medicine for my masters thesis, the goal of understanding the causal mechanisms of every disease at the molecular level and using that information to predict and prevent disease in individuals. It’s also called personalized medicine, but the term “precision” has become preferred in the last decade. The entirety of the US biomedical research enterprise is focused on this goal (also to the delight of pharmaceutical industry). As a result, research into the known environmental harms that cause diseases like cancer, dementia, asthma, etc. has been deprioritized. Precision has taken over everything, another example is precision education, also socio-behavioral genomics. We’re so devoted to finding the answer to everything in our genes that there’s no political will to tackle the (messier, more complicated, less neoliberal-friendly) environmental and social problems. Reading this section was really useful for me to further contextualize the “precision” drive and the “big data” imaginary in general as a kind of ignorance-generating project. If the answer to every complex question is “more data” then all of our collective energies need to be expended on data generation, at the expense of everything else.

Talia Parkinson

I think it makes sense! This is a bit far afield, but it reminds me of a different thought I often have about how we tend to attribute technology to singular "inventors", rather than acknowledging to complex network of contributions within an entire field to reach the destination. Thinking about technology as an iterative conversation -- perhaps even evolutionary in its own way? -- send a lot more accurate to reality.

Zindagigi

I think large scale adoption of technologies is the point where the genie might be put in the bottle, so these are decisions that are made at a higher level of society. I can think of some examples that have had pretty negative consequences for us, but mainly, the systemic rejection of train-based transportation is a big one. A more positive example would be the ejection of whatever man-made materials were used in refrigeration and, I guess, hairspray (?) that lead to the Ozone hole--scientists figured out that technology was doing harm and policy makers succeeded in pushing through policies that halted the production and use of these materials and now no one talks about the ozone hole anymore. Theoretically, the same thing could happen with AI, which we know requires gigantic quantities of land and water and energy to produce, and that these costs are highly localized. If local communities have the power to say no to AI centers--or to negotiate benefits for themselves that make the burden of hosting these centers worthwhile--then AI theoretically would become more expensive at the consumer end and much of its current use would be disincentivized. This isn't exactly a cultivation of "ignorance", in a strict sense--we aren't so much forgetting things as choosing to ignore them in some sense.