Unchecked: The architecture of disinformation
Misinformation and disinformation thrive in today’s technology landscape, and arguably present the greatest threat to modern society. Information architecture – the practice of designing and managing digital spaces – has an opportunity to intervene. This podcast looks at disinformation from an information architecture perspective, and considers ways to expand the practice of IA to address this new reality.
•••
What is Information Architecture? Information architecture is the practice of designing virtual structures – the shape and form of online spaces and digital products. When you click on a navigation menu or follow the steps in a process, you're experiencing the information architecture of a web site or digital product.
•••
What is disinformation? Understanding disinformation is the purpose of this podcast. We are trying to figure out exactly what it is and what it means. If information architecture is the practice of designing virtual spaces, then disinformation is something that can occupy that space to disrupt the user's experience. Alternatively, it is a way of manipulating the space (like flooding it with irrelevant facts) to achieve an end unrelated to the space's original intention.
Unchecked: The architecture of disinformation
S02 Trailer: Reflections on Season 1, What's coming, What we hope to explore
Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.
SYNOPSIS
Dan and Rachel kick off Season 2 of Unchecked by looking back at what season one taught them and what's ahead. We reflect on the toll of researching disinformation. They also preview season two's research directions, including Rachel's interest in the everyday myths people unconsciously rely on and Dan's theory that there's a "big lie" at the center of every domain, plus topics they're eager to dig into next.
Edited by Jared Landis <https://www.landispodcastediting.com/>
_____________________________________________________
Personnel
- Dan Brown, Host
- Rachel Price, Host
Music
- Turtle Up Fool, by Elliot
_____________________________________________________
Unchecked is a production of Curious Squid
Curious Squid is a digital design consulting firm specializing in information architecture, user experience, and product design
At the center of every domain seems to be a big lie.
RachelYes.
DanAnd that a lot of the other misunderstandings, misbeliefs that we have about a domain can often come back to that central big lie.
SarahYou're listening to Unchecked, the podcast about the architecture of disinformation with Dan Brown and Rachel Price.
DanWe're here to kick off season two. Yeah. Why did we take a break, Rachel?
RachelEnnui. That's my answer.
DanI'm serious. It was it was a thing.
RachelThere was a little bit, quite a bit of enui. Thinking about misinformation in the way we have can have its upsides, but can also have its downsides. It gets really heavy.
DanYeah. I think in one of these episodes, I said we have to go where the misinformation is. And the misinformation is in everywhere. It's everywhere, but it's most apparent in the yuckiest of places.
RachelYeah.
DanI think we can't avoid that. But you and I don't, for our day jobs, for our regular lives, are very fortunate that we don't have to spend a lot of time in those yucky places.
RachelNo, I'm just kidding.
DanSo I do feel like it took a lot out of us.
RachelYeah. Challenge can cause growth, which it did. I feel like I grew a lot, but it's also really exhausting. And we're humans with lives and families and jobs. And the battery needs recharging sometimes.
DanThe battery needs recharging. That's a very loaded question. Do you feel like you were starting to feel hopeless?
RachelYes. That's not a loaded question.
DanI think it's pretty straightforward. Pretty straightforward. Well, I mean, part of that is the fact that we're trying to create a framework to address the issue.
RachelYeah.
DanAnd at the same time acknowledging that the issue is so big, so pervasive, so inherent in the system that we're really just scratching at the surface, if at all.
RachelYeah. And I this is not a very hopeful take. I don't hope to solve misinformation. That's not an option. Right. And so it kind of feels akin to like spending a lot of time sitting and thinking about death. Yes, I can develop frameworks for thinking about it and lenses for considering it. I'm not going to solve it. Like it's still, it's it's there. Death you can come to peace with. Misinformation, I don't know. Like, do we come to uh terms with it? Like, is that also the goal? I don't know. It's very confusing.
DanRight. We don't have an answer to that question of if it's not solvable, what is our attitude towards the phone?
RachelOh, was I not? Was that a spoiler that I don't think it's solvable?
DanWell, I think it's an important reminder for us as we go into the next season. And maybe I did start to feel like can we chip away at this at all?
RachelYes.
DanAnd the problem is too big for any one designer to solve.
RachelYes.
DanI do think we need to add to our repertoire methods, techniques, approaches, attitudes that allow us to see the problems more clearly, at the very least.
RachelYes. I'm being a little bit cheeky when I say it's not solvable. We're not going to completely solve it. We're not going to eradicate misinformation from the human existence. I do think that I've learned a lot about the different angles you can approach it with. And I've seen new sides of misinformation problems that, you know, when you get a different vantage point, you suddenly see a thread you can pull on to start undoing some knots. And so that has happened for me. And I hope it's happened for some of our listeners. I might go so far as to say it might have happened for some of our guests. But that's a bold claim. We've gotten some good feedback. That's all I'm gonna say.
DanYeah. I do feel like, and this is not me trying to pat ourselves on the back, but the purpose of talking to these folks is because we are asking them to look at their own work through a different lens as well.
RachelYeah.
DanSo I think we get some unique perspectives by talking to them about this stuff. I do come out of season one feeling like this is a real project. There's real stuff to be learned here. There's real stuff to explore here.
RachelYes. Okay. Think back to episode zero, the pilot. Do you remember how young we were? I know. Sweet summer children. Do you remember your frame of mind back then? And if you can take yourself back to that place, like what has changed between then and now for you?
DanI would say, and this really has only happened to me just in the last few interviews. But I'm really forcing myself to look at information ecosystems. So it's a it's a technical change. I don't know if you were looking for some kind of other emotional change or a sense of maturity, but there's a I would never expect that from you. Thank you. You know me so well. There's sort of this technical angle. And part of this is frustrating because I feel like my job, Low these decades, have been to look at information ecosystems and really try and understand them. But we've had the benefit of those ecosystems being fairly narrow, and we've had the benefit of those ecosystems really trying to serve a single purpose and not having the distraction of misinformation or manipulation through disinformation. So now I'm trying to look and understand the system that's going on behind the dynamics that the person that we're talking to is talking about. So they may be talking about kind of the media environment around gun violence, but we're trying to look below that and trying to understand the systemic elements at work there. I feel like that's some nuance that has changed since that pilot. Does that make sense?
RachelYes. But I mean, we we kick the pilot off talking about ecosystems.
DanRight.
RachelSo help me understand is it your intentions that changed or just like the the altitude?
DanI think the sensitivity. We talked about it because it was a good metaphor, but now I'm trying to understand what that really means. Yeah. And sometimes just in life, I have trouble seeing the forest for the trees. So this is not to pick up on the ecosystem metaphor, but just to sort of understand how all the parts move together. I was just listening to our last episode of season one, and we really did get into the nitty-gritty of what is the system of data and how does it move through? And we've already taped some interviews for season two. And I feel like some of those questions that we got to ask of those guests were really about the systems in which they were operating.
RachelYeah.
DanRather than about the nature of the information itself or things like that.
RachelOh, I see. I understand that difference now. And I think this rings true to me because I was I'm looking at our notes from episode zero. And we've kind of mentioned this in a couple of episodes where we think it's so cute now looking back that we were trying to define the types of misinformation and disinformation and kind of treat it like this entity, this noun or something. And I think for me, my beliefs about what misinformation is have really shifted to accept kind of a lot more ambiguity or fuzzy boundaries around what misinformation is. So I'm looking at our notes and we made this note like, okay, what's out of bounds? Like, what are we not going to try to cover? And we said there are lots of things that people use in the same way they use disinformation. Here's a list: propaganda, conspiracy theories, theatrics, and trolling. And I would say the only one we really have actually done a good job of avoiding is conspiracy theories. Right. I'm laughing at the propaganda one because I have since come to terms with the fact that propaganda is just a formalized mechanism for distributing misinformation. Right. And so what's changed for me is when I started, I look, I kind of thought of misinformation as this bounded object. And through all the conversations we've had, I've I now understand it more as a hyper object. It's a really much more amorphous entity than I had really understood before. And I think you see it being the systems that distribute and hold up this entity are almost easier to explore because they're somehow a little bit more finite and a little bit more concrete.
DanRight. What research question are you taking with you into season two, based on that? Now that you've got this foundation, we've done misinformation 101. We're in now an upper level class, presumably. What's your research question?
RachelUh misinformation 102 is actually called mythology.
DanOkay.
RachelNo, I'm really interested in the human component of misinformation. So it's funny that you're like, oh, I'm thinking about systems differently. And I think that's awesome. And humans also form systems. The parts of conversations I've been really drawn to and wanted to spend more time on is thinking about the myths that we tell ourselves. And that's often misinformation. Right. But it's uh got a different flavor to it. And I'm really, really interested because I think they can feel so benign and yet they are so prevalent and have such intense influence on how we operate every day. That's not a thesis, but it is an area of focus.
DanAaron Powell These myths are embedded in different domains, like we've been talking to folks about. Okay.
RachelYeah. So I'm thinking about the myth of calories in, calories out. Right. We haven't talked about this. This is one I want to explore. We've talked to a couple. Cowboys. Yeah, the the myth of the American cowboy. Yeah. A lot of myths around immigration in an upcoming episode. So it's almost like when you talk about misinformation as a thing that happens on social media, as like published information, it almost creates some distance between my daily existence and like that article going viral. But when you talk about the role of misinformation in myth making, then you suddenly see how much bullshit is woven into your life.
DanRight. And how much you rely on those myths, whether you intend to or not, to just sort of make sense of the world. And even if they didn't start out as misinformation, maybe they started out as well understood to be stories or narratives that provide a life lesson or whatever. They've since become so embedded that people will justify their beliefs, say about guns by relying on a myth that we've all come to understand and believe in so much in our bones that we assume that that is sufficient foundation for the truth.
RachelYes.
DanI like where that's going.
RachelSo next season.
DanMyths.
RachelEveryone's gonna get tired of hearing me bring everything back to myths.
DanI kind of want to take a little bit of a detour because of what you just said. I feel like Rachel's thing in season one was framing. Oh, yeah. We talked so much about framing, which was good and appropriate. And did you get tired of that talk?
RachelI did not get tired of it, but I assumed you were tired of it.
DanRachel, I could never get tired of anything you want to talk about.
RachelIt almost became this thing that I think framing is so ubiquitous, I had to just stop naming it for a little bit.
DanRight. There was another concept that came up that I feel is like is very similar, and that is friction. Friction came up quite a bit. We talked about, you know, it's sort of a property of an information ecosystem of how much friction is in there to maybe prevent lies from getting out, or that make it difficult for us to counterbalance a lie with the truth. And I think both of these things, framing and friction, and a number of other things that we have been talking about, there's an opportunity for us to dig in further and identify maybe a taxonomy of the types of friction, the types of framing that are present. Are you laughing?
RachelI should not be surprised that you want to create a taxonomy out of it.
DanYou should not.
RachelOh, we're de we're very different, IAs, Dan.
DanThat's what makes it work. You know, we throw these big ideas around, but I think there's value in doing some analysis to try and understand when we talk about friction, is it all friction the same? Are there different ways in which friction can be applied in an ecosystem? Do some types of friction work better with some kinds of information? I think all of these are really interesting for me to pursue and maybe for you to do that.
RachelNo, I'm just kidding.
DanYou got this, Brown.
RachelNo, I got this. Can you give me, do you have any examples top of mind for like what are different kinds of friction that we've talked about?
DanNot off the top of my head, but let me see if I can make one up real fast. So when people say introduce friction into a user experience, it's always some kind of like dialogue box that pops up. Are you sure you want to do this? Yeah. That kind of thing. So there's that sort of basic friction. And maybe we can call that the personal experience of friction. But I'm wondering, is there a way to socialize that a little bit more? Like your post needs to be reviewed by a couple of peers before it gets posted, right?
RachelOr so another example of friction, I think you could one could argue that like the stepwise wizard pattern is a form of friction. I think there's a strong relationship between like scaffolding and friction. Yep. That's interesting.
DanAaron Powell Where the friction is not so much barriers, but instead sort of additional requests for information. Yes. You want to post this, you must add tags, you must do this, you must do that before you can put out some information into the world. I think there's some interesting potential patterns there. The one that I think cuts closer to your question about mythology is, and maybe this is just the other side of the coin, is I became really excited and interested in at the center of every domain seems to be a big lie.
RachelYes.
DanAnd that a lot of the other misunderstandings, misbeliefs that we have about a domain can often come back to that central big lie. So that's one of my research questions for this next season is does everyone have the same understanding of what that big lie is at the center of their domain? And is it in fact true that every domain has a big lie?
RachelAaron Powell Any good conspiracy theorist would tell you, yes.
DanYes.
RachelThere's absolutely a big lie.
DanAnd does that big lie change over time? I think it does out of necessity, but yeah, that's really interesting.
RachelNo, I was going to crack a joke about how if we go chasing down the big lie in every domain, then we might become conspiracy theorists.
DanRight.
RachelAnd honestly, is that so bad?
DanI mean, that wouldn't be too far to fly.
RachelThey seem pretty happy.
DanThey have an explanation for everything, which is more than I can say for myself right now.
RachelOh my God. Yeah. Okay. So I was going to scan and look at at all the topics we covered in this first season, just to name a few. We talked about gun culture a couple different times. We talked about abortion. We talked about nutrition. We talked about climate change a couple times. We talked about federal information spaces, vaccines, civic tech. Okay. I don't want to make you pick favorites, but does any one of those topics like haunt you? I'm framing it as being haunted rather than uh it being your favorite.
DanHaunt me.
RachelYeah.
DanI mean, all of them do, to some greater or lesser extent.
RachelAaron Powell But which one's the big gloss ghost?
DanWell, let me start with the one that I came away feeling much more hopeful about gun culture than I thought I would.
RachelAaron Powell After talking to JJ?
DanYeah, after talking to JJ. And also dovetailing that interview with talking to Brandon Schauer about their work on climate, there seems to be that they've internalized this idea that you can't fight a lie with the truth. And so that they are finding other ways to move the needle on culture to not to brainwash people, but just to make sure that there's an understanding that there are other ways of handling gun safety, for example. And that made me far more hopeful than I anticipated about gun violence.
RachelWere there any of these domains we explored that has like stuck with you for some reason? Which I think you answered with the gun culture one?
DanYeah. I just have personal interest in reproductive rights. And it's, you know, been a cause that I've been passionate about for a long time. And I was so happy with that interview. It was gratifying to me, as someone who feels very passionate about that issue, to hear a scientist talk about it in very even and direct terms. And if we were to compare, there's no way to compare apples to apples, but I do feel like the reproductive rights conversation, just based on what I've seen and what we talked about, is not as far along, shall we say, as the gun safety conversation. And this is just from the few interconversations that we've had, but I could see continuing the conversation in reproductive rights, because I'm genuinely curious to see what other efforts are being made that might be similar or adjacent to the work of media influence in the gun safety culture.
RachelYeah, I love that. The topic of misinformation around abortion and misinformation around nutrition, I agree with you. They're like less far along in their journey. And so I care about maybe this is naive or egotistical of me. I care about lending a helping hand to developing those conversations. Sure. And I, you know, I don't delude myself. I don't think this podcast is gonna change the world.
DanNot moving the needle on anything.
RachelI can't even say it with a straight face. Um, I'm having a great time. I hope you all are too. But I learn from these guests. I learn new things and I learn ways to think about. And we get to meet these people and we get to hear who they're working with and start to follow those people and meet those people. And that, just on a very personal level, is really one thing that does give me a great amount of hope. I think at the end of the day, even when I'm feeling hopeless about some of these topics, all of these topics, connecting with other people is the thing that kind of brings you back down to earth.
DanRight. We have talked to people who are, I think you pointed this out in that conversation with JJ. Like you're talking to people who are like genuinely working on these things.
RachelYeah.
DanAnd it can be very easy when you don't have conversations with those kinds of folks day in and day out. It can be very easy to think nothing is moving, nothing is changing, no one's working on this, no one's thinking about this. So at the very least, we've had that.
RachelYeah. So now I want to flip this question. I asked you what topic is haunting you? Because I want to draw a line from that to what are you looking forward to? Are there any domains that you want to explore in this next season, or that maybe we've already scheduled to explore in this next season that you're particularly excited about?
DanWe've talked about a few topics that I'm curious if there's a there there. And the reason why I'm really like, I'd want to have someone on, even if we're not convinced that there's like a real misinformation problem there, because there probably is a misinformation. Like my hypothesis is there's a misinformation problem everywhere. There's a big lie at the center of every domain, no matter how small. And I would like to test that hypothesis.
RachelAlso, if there's a domain where you're like, I don't know if there's much there, that could be evidence that there is an excellent big lie that is working so well.
DanSo well, right.
RachelThat even Dan and Rachel are not aware of the two of the world's smartest people can't see it.
DanNo. I mean, we have on our list parenting, which is a very broad topic, but I thought it was hard to parent young children in the early before the internet existed.
RachelIt was Alta Vista. I don't know if that's really the Internet.
DanAnd it's even different between the first and the second one. And I know you are now parenting a smaller person in these weird.
RachelIn a very healthy and thriving world.
DanSo and part of what you are dealing with as a parent is this like enormous loud cacophony of parenting advice on parenting TikTok or whatever the hell it is. So I feel like spending some time unpacking that would be interesting.
RachelYeah.
DanMy generation is also dealing with aging parents. And it's been fascinating because anyone I talked engage one-on-one to talk about it, anyone a contemporary of mine, we're all in agreement. This sucks. It's hard. We were not expecting this. There are unexpected challenges that we're facing, but I don't see like a public dialogue about how do we deal with aging parents. I guess what I'm getting at is we haven't identified any prospective guests on this. Like I wouldn't even know where to look. But like that's personally interesting to me. And so I'm kind of curious about that.
RachelWe can figure out where to look. There are definitely people who talk about this.
DanI'll say one more topic. We have not had a conversation with the sole exception of Claire Wardhole, but we didn't even go in depth with her on AI. Yeah. And I don't want to talk about AI as a misinformation machine. I want to talk about the misinformation about AI. And if there's a guest out there who would like to talk about that, please. Come find us. All right. What are topics you're excited about?
RachelI am very excited. We started to touch on disinformation and nutrition with Dr. Amelia Fenrey. And I'm really excited to go deeper on that. I think this is a really weird, sticky topic, especially for Americans. Yes. We're all so messed up. We're all so messed up by wellness culture and diet culture. And a lot of that is misinformation from the nutrition domain. And it affects all of our lives. I've spent a lot of time personally thinking about it. And so this is one of the topics that I'm pretty passionate about starting to explore and put on the podcast because I think this is one of those massive lies that is so effective that a lot of very smart, wonderful, well-intentioned people have no idea just how much misinformation they're consuming around this.
DanRight. All right. That's the that's the one.
RachelYeah, that's it. Nothing else. I don't want to know. Um no, that's the big one on my mind.
DanThat's a good one.
RachelYeah.
DanI'm excited because I am pretty sure we've got one of those coming up.
RachelI'm pretty sure we do. I mean, I guess we've talked for long enough. We've probably got too much material.
DanOverstayed our welcome.
RachelWe've overstayed our welcome. Nobody's here to listen to us talk. They're here to listen to our amazing guests. Right. So maybe we should just wrap this up and move on to season two.
DanAnd that was Unchecked. Thanks so much for listening. We really want to hear from you. If you've got ideas for topics or guests or stories, drop us a line at unchecked at curious-squid.com. If you made use of the lenses that we described today in your practice, we want to hear about that too. Hey, check the show notes for any of the links that we talked about today, and it would really mean a lot to us if you shared this episode with a friend and rated and reviewed us on your favorite podcast platform. Thank you.