Home Creators Posts Import Register Favorites Logout

Content

(a quick note: i'm seeing that patreon has blocked some comments from last weeks post, idk why, they look fine, I'm trying to fix it this week to not do that...)

alright, week 2! gonna try something a little different here (dont mind me constantly iterating on this format) and give some thoughts on your comments from the last chunk before sharing my note for this one:

to speak just to confusion Lidija and p.m.pilgrim expressed as to why the opening examples include both technical accidents like Chernobyl and motivated actions like 9/11: I think it's that both illustrate the limitations of prediction and control of risk in highly complex systems enabled by science/technology. Whether accidental or intentional, they're both negative and unintended consequence made possible by some advancement (nuclear physics/aeronautic engineering) . I might also add that that risk existing isn't the problem, so much as how that risk is negotiated. While I understand Craig's suspicion at designating harmful side-effects as an inevitable fact of science that justifies exploitation, I'd add that the inevitability of risk in the application of science is analogous to (or maybe even an outcome of) the inevitability of uncertainty in the knowledge-building of science: it's always gonna be there in some amount, so we should remain aware of/reflexive to that reality rather than think we can control/transcend it. Like AJ said, "our ability to create new and shocking horrors will always outpace our ability to handle them"---i'd just add that I think Jasanoff's thinking through how we can improve our responsiveness and democratic-ness in handling them.

ok, now for this weeks text. if the first reading was establishing the problem of risk in scientific modernity, this reading is looking at how some have attempted to address it (curious how it will connect to the paper you referenced, 'personhood for pigeons'). Something that stood out to me in this reading that I didn't think twice about first time around was this paragraph towards the end of the chunk:

"The Monsanto Company’s experience with the ‘Terminator gene’ suggests that political activists may seize control of decisions on their own terms, unless governance structures provide for more deliberative participation. In this case, the mere possibility that a powerful multinational corporation might acquire technology to deprive poor farmers of their rights, galvanized an activist organization – Rural Advancement Foundation International (RAFI) – to launch an effective worldwide campaign against the technology. Through a combination of inspired media tactics (including naming the technology after a popular science-fiction movie) and strategic alliance-building (for example, with the Rockefeller Foundation), RAFI forced Monsanto to back down from this particular product. The episode can be read as a case of popular technology assessment, in a context where official processes failed to deliver the level of accountability desired by the public."

Did anyone else's head go to anti-AI organizing efforts when reading this? Maybe my minds just here bc of the AI discourse stuff I was talking about in the last office hours, but the roll out of gen-AI is certainly a case where governance structures aren't providing deliberative participation to some exploitative tech, and there's definitely a clear desire in some section of the public to push back on it. Makes me want to look into RAFI and also what modern equivalents might be taking shape in our current tech landscape--I know about organizing efforts against the construction of data centers in various cities, but I'm curious if anyon'e heard of other organized campaigns that are going on?

happy reading, and looking forward to hearing your thoughts!

Comments

Jonas Ladefoged Holm

My thoughts went straight to datacenters, and the harm they do to their local societies, and how they feel so symbolic of what Yanis Varoufakis calls "Technofeudalism" I've felt the need for protesting against this development and have started to move my life to my own self hosted cloud. In the gamer/tech enthusiast space there is right now a lot of focus on transitioning away from the bigger companies in favor for open source solutions hosted by the people. The advent of Ai and crypto before it, made computer components so expensive, and now that one of the few RAM manufacturers have announced they will close down their consumer facing lines, in favor of their enterprise customers, who will be using it for their very memory hungry Ai datacenters, the it guys are pissed. Thing is, IT-people would on average rather just silently exit the influences of big tech, and build a better alternative, change consumer habits, rather than fighting it head on with protests. So that's how I see it, but I feel like protests are right around the corner and I would be joining.

AJ Biffl

I'd also highlighted the monsanto segment because I thought that fight had actually been lost already and terminator seeds were commonly used, but after looking into it - no! RAFI actually worked! Legislation in India in 2001 and Brazil in 2005, UN moratorium in 2006. So maybe there is hope! ("hybrid seeds" that produce fertile offspring ARE common, but that's another thing) When SJ talked about all the practical problems and efficacy problems and politicization problems (pg 237) I kept having this reflex to retreat and give up. I keep defaulting to the thought that state-based framing is too broken to allow solutions-without-problems. Formal processes to extract public participation bias towards privileged, established positions. Politicized controversy is incentivized to deepen ideological divides and artificially sustain loyalties. Questions of political organization have no answer because state-centric politics isn't an answer. But I have to remind myself to stay hopeful: surely there's some way to prevent science from blowing the world up that doesn't involve setting it on fire instead. I think a lot of those problems center around institutionalizing and formalizing procedures around a goal instead of just allowing for motion toward that goal while trying to hear different perspectives on it. I've kept myself from reading ahead, but I'm looking forward to reading Jasanoff's ideas for solution.

AJ Biffl

As far as AI, I'm not sure of their status but I've heard about several large lawsuits against AI companies, and I sort of expect copyright-angled corporate protections to be the largest place that the state will try to restrict AI

Jacques Vincelette

Today, Canadian Nuclear Laboratories are formaly handed over to American military contractors Amentum and BWXT (Business Bureau investigation closed). On Canada's commitment to peaceful application, management tells me we are careful not to make any moral judgement on war, peace, or the application of our work. These are dismissed as political. Sheila Jasanoff pointed out in -New Assessments " keeping expert knowledge away from the vagaries of populism and politics." In The Participitary Turn, Sheila states "that compulsory disclosure of data will enable any interested party to challenge researchers’ interpretations of their work. Participation, in this sense, becomes an instrument to challenge scientific points on political grounds. By contrast, public participation that is constrained by established formal discourses, such as risk assessment, may not admit novel viewpoints, radical critiques, or considerations lying outside the taken-for-granted framing of the problem." 'Scope of Work' defines our limited responsibility and 'governance' is framed in terms of duty to shareholders. Kebaowek First Nation push back on the failure to consult with First Nations as required under both the UN Declaration on the Rights of Indigenous Peoples (UNDRIP) and Canadian . Concerned Citizens of Renfrew County oppose the management of Canadian Nuclear Laboratories by a consortium of American military contractors.

Jacques Vincelette

Our new CEO emphasized this morning that CNL is the only institution on both American continents dedicated to commercial nuclear. Commerce does not distinguish between military or civilian application. Beyond sanctions, what are the implications on Venezuelan institutions?

Emiel

It's interesting to learn about the how the relationship between states and scientific advancements has developed over the years, but personally I also find it hard to relate to this story at times. This might be because the paper was written in a different time and a lot of the things described as new developments are to me things that have always been that way. I think an important development in discourse about the risks of technology since this paper was published is a shift in which risks we focus on. This paper seems to talk more about unintended harm to people caused by new technologies or poor management thereof (EG Chernobyl) rather than harm done intentionally by people wielding technology as a tool. The latter seems more prominent now; in last weeks chunk Dr Fatima pointed out the shift towards technocracy discourse being mostly about silicon valley since the last decade. Anecdotally, I also see this focus on possible unintended harms in the way people around me (admittedly, at the time mostly white & liberal) talked about the terminator gene when I was younger: the worry was about the genes breaking confinement or causing health problems, not about their use in restricting peasants' rights to reuse seeds from their crops. Politically you see this too, the EU prevents commercialisation of the terminator gene through restrictions on GMOs, but also forces intellectual property laws (which limit use of seeds) onto countries when signing trade agreements.

AJ Biffl

That shift about "which risks" is really interesting too because a lot of the risks of social media and now AI are fairly hidden or are hard to quantify (or hard to prove direct causal links), things like mental health and radicalization

personhood for pigeons

I'm only just getting to this post, but hopefully my contribution is still useful to other folks. The Jacobs article I mentioned last time (The Challenges of Participatory Administration 2024) expands on the "practical problems" with participatory governance (p. 237 1st full paragraph). Jasanoff says that people may lack the specialized knowledge or resources to participate, participation can occur too late to affect the decision, or is too specific to a particular issue to affect broader policy, and increased participation can exacerbate controversy. What might as helpful contact is a quick explainer on "notice and comment rulemaking," the most common form of participatory administration. An agency will propose a rule, and open it up for public comment, always online, often in hearings too. Anybody can comment, and often thousands are submitted. The agency then finalizes and adopts the rule with a published rationale. The proposal, comments, and agency rationale are the "record." Then, anybody harmed by the rule can sue, claiming the rule is "arbitrary and capricious" because it didn't comport with the facts or didn't sufficiently consider a valid idea presented in the comments. In the lawsuits, courts are generally deferential to the agency's expertise - because why would a judge be more knowledgeable than expert administrators? So in short, to effectively weigh in on the most common form of participatory regulation, you have to have the resources to: read, understand, and submit a strong comment to the agency, so strong that the agency is afraid of being sued on the basis of the comment. Comments with strong, irrefutable data tend to be best, meaning "expert" comments are the most influential. If the rule is pro-industry, those industries will intervene in any lawsuit to support the rule. Overall, it takes lots of time, effort, and political power to meaningfully affect agency rulemaking. State and federal governments have tried to create more ways to participate, to limited success. For example, intervenor compensation programs (where less-resourced parties are paid to participate), negotiated rulemaking (where stakeholders and the agency negotiate a rule before the normal notice and comment rulemaking process), and citizen advisory boards. Jacobs argues that the value of these efforts is limited and hard to measure. Excited to finish the paper this week! I'll have more developed thoughts of my own then

River

I have also noticed efforts to tackle these problems with community organizations, and building up the next generation, rather than head-on protests. I remember when AI started to do art a few years ago, and it created lots of talk and crisis in the artists community. I saw one artist say, that in the past decade, artists had found their livelihood in many creative industries like graphic and logo design. Jobs, which were now set to be replaced by AI. And yes, there are efforts to discourage companies from going to AI for these tasks. But, he thought, the more effective transition, would be to change the way artists are employed in society. He advised artists to focus on the humane and community aspect of art. Coming together to do art in workshops, in teaching each other, we can make art relevant to everyday life in a way which doesn't rely on corporations. And, a few years on, I can already see many community events that are being organized around art. Pottery workshops, meet and greet over origami. I have seen a revival of events like that. I hope these small steps would shift people away from being so online all the time, and spending more time with community.

River

I found this section exciting!!! I do see the risks discussed here, are a bit backdated. I feel like, in 2025, our risks are mainly: radicalization through social media; the effects of social media and AI on our brains and thinking process and our ability to connect and make relationships; usage of technology in educational institutes; the role of media in politics.

Emiel

Bit of a late addition, but I just ran into this quote that reminded me of the topics of genetically modified crops and scientists wanting their work to be politically neutral. From a scientist working on genetically modified potatoes for BASF, after the crop had been banned from EU markets: "it's hard when you see an innovative product go through the loops again and again. These decisions are not about science but about politics"