A.I. Safety Goes Mainstream + a ‘Hard Fork’ Exit AMA

Reading the AGI Chronicles

0:00This is actually really big. Do you know what I did ahead of our final episode? I'm actually quite proud about this. What'd you do? I finished reading your book. Wow. And I really loved it. The AGI Chronicles. It's very fast moving. It's fun to read. And something that I really liked, it was gossipy and juicy and bitchy in a way that these business books almost never are. And of course, I don't want to take any credit for anything that you did, but I would like to think that just a little bit of me rubbed off on you. Although the truth is you actually always been very gossipy ever since I met you.

0:31I know. Well, I did not set out to write a juicy gossip book. It was supposed to be like a sober history of science. And then you start talking to these people and they're the biggest gossips in the world and they all hate each other and there's so much drama. And I felt like I was freaking, you know, Harvey Leavitt on TMZ just sitting there scribbling all of this down. It's honestly very hard to write a sober history about people who are on mushrooms all the time. It's just, that's just not really going to happen. Hey, let's be fair. They also do ketamine. Yeah, okay. I'm sorry not to leave out the K enjoyers out there.

1:04Well, thank you for reading the book. I did not ask you to do that. I frankly did not expect you to do that. I know it's been many years since you've read a book, probably since Harry Potter, the last Harry Potter came out. But I'm honored. I'm touched. I'm so glad you like it. It was great. I can't remember. We were talking about books recently and I mentioned that I was reading your book and I mentioned some, you know, future book that I might read. And you stopped me and you said, Casey, my book is the last book you're ever going to read. And I thought, well, we may have something there.

The AI Safety Vibe Shift

1:43I'm Kevin Roos, a tech columnist at the New York Times. I'm Casey Noon from Platformer. And this is Hard Fork. This week, why everyone is talking about AI safety. And then for our final episode, we'll answer all your questions about the show and what we're doing next. I was thinking about getting lunch. Let's do it.

2:13Well, Casey, we picked a hell of a week to take off last week. Boy, did we. And thanks to all the listeners who wrote in asking us, how dare we take any time away during a very busy and important time in the world of technology. Yeah. And to those listeners, we have one message, which is this is our last show. We heard you. We hear your frustrations. And so we are stepping down in shame. One star Apple podcast reviewers. Your words have finally paid off. This will be the last you ever have to deal with the likes of us. So there has been just an enormous amount of news in AI over the past week or so.

2:50It seems like this conversation about AI doom, AI risk, existential threats from AI has really gone from sort of our bubble to a much larger bubble that includes politicians and just random people in my life who have been texting me asking things like, are we all going to die for real? So let's talk about all of this. It has been one of the fastest, most sudden shifts I've ever experienced. Yes. And I hope if you're a longtime Hard Fork listener, you've been feeling somewhat vindicated over the past few weeks because I know Kevin and I have.

3:22Right. Like we have been trying to bring you stories about this almost ever since we started the show nearly four years ago. And just within the past couple of weeks, it seems like there was some kind of inflection point and the vibe has shifted toward AI safety. Totally. So let's talk about what has been going on and what we feel about it. But first, since this is a conversation about AI, let's do our disclosures one last time. One last time for real time's sake.

3:49Kevin? For the next 48 hours, I work for the New York Times, which is suing OpenAI, Microsoft, and Perplexity. And my fiancé works at Anthropic. Okay. So let's kind of do a speed run through the AI news of the last two weeks. The first sort of domino that I think really started to fall here was the now viral resignation posts of Jacob Coxon, a former researcher at Anthropic and OpenAI, who went online last week and publicly announced that he was stepping down, saying that neither company, OpenAI or Anthropic, is acting responsibly.

4:27They are racing straight to self-improving superintelligence and gambling with our lives. This kicked off a firestorm of attention, follow-on posts from other AI insiders saying, we agree with him, people piling on and saying, this guy is crazy. But people basically, from what I saw, were saying, yeah, this is what we've all been talking about for years now. And in one group chat of Anthropic employees seen by the New York Times, one employee wrote that Jacob took the group chat public, and that's a good thing.

5:02Yeah. I mean, it was so fascinating to watch his response. And I have to tell you, this was a moment where I felt like, oh, no, I really am in a bubble in a bad way because when I read his post, it did not faze me. Like this, like what Jacob said, as important as it is, is also like the median dinner table conversation in many households across San Francisco, including mine, on many evenings. And so when I first saw it, I was like, oh, okay, he's decided to opt out. What I didn't count on, I think, Kevin, was that the response to that OpenAI hugging face incident has really gotten people thinking differently about these sort of things.

5:40And so I think people are just much more prepared to receive this message today than they were even a few weeks ago. Totally. And I had the same realization about the bubble that we live in here in the Bay Area when I saw a follow-up post from one of Jacob Cox's former co-workers at Anthropic, Evan Hubinger, who sort of, you know, quote tweeted his post and said, I also believe that AI could kill all humans, and he attached a specific probability to it. He said, I think there's a greater than 10% chance that this could happen.

6:13And my reaction to that was, that's it? Like, for me, in the world that we travel in, people who have a PDOOM of 10% are considered somewhat optimistic. Like, among the AI researchers at the labs that I've been talking to and interviewing, people have much higher probabilities that all this could go badly. And yet that number seemed to register on a scale that I have not fully appreciated. People are saying, wait a minute, these people are racing to build something that they think could have a 10% or more chance of killing us all.

6:45Why are they doing that? They should stop doing that. Yeah. And I think maybe it's worth pausing for a beat, Kevin, on some of the logic here, not just in Jacob's post, but in some of the follow-on posts that you mentioned. Because I think if maybe you just saw that post and didn't dig any deeper, you might be inclined to dismiss this as just more AI doom from a bunch of cultists. But I mentioned that OpenAI hugging face attack a little bit ago, and I think it's really important here. Because, as you heard Ajayya Kotra say on a recent episode, there was something surprising about how misaligned these AI systems are, even in their current state, which the researchers still see even today as somewhat primitive compared to where we think they are going to be in six months or a year, right?

7:34And what I heard Ajayya say was, look, we sort of assumed we would start to see this kind of scary collaboration between agents sacrificing themselves from each other. We thought that might come, but we thought it was going to come much later. So that's sort of like pillar one, I think, of what's going on here. Pillar two is all of the big labs, including OpenAI and Anthropic, they are racing toward recursive self-improvement. And they're putting out posts that are trying to say, in a very gentle way, the new models look like they're kind of getting there.

8:04We're already using these models to build the next version of the models. Like, if you believe that recursive self-improvement is a spectrum, we're kind of getting ever closer to, like, the genuine article. And so if you have this unsolved alignment problem and you have imminent recursive self-improvement, then you might actually have a problem. And so I think it totally makes sense that some people would quit over it. Totally. And I think the vibe has also shifted inside these companies, where, like, until maybe three or four months ago, there were teams at these companies of safety researchers, alignment researchers, who were very worried about the risks.

8:39But there were also teams that were not as worried about the risks. There were teams that just worked on improving the capabilities of the models or researching new breakthroughs, who were sort of, like, at odds with the safety researchers, even in their own companies. And what I think we've seen over the past few weeks is that that has shifted, where now even the people who are sort of the optimists, the accelerationists inside these companies, the people working on capabilities, are getting spooked by how quickly the systems are improving. Absolutely.

Dario Amadei Calls for Slowdown

9:08Now, should we talk about the reaction from the leaders at the big labs in the wake of all of these discussions that were kicked off? Yes. So on Saturday, Anthropics CEO, Dario Amade, released a 3,800-word essay called We Must Pace the Frontier, where he called for essentially a global coordinated AI slowdown. I'll just read a few lines. He says, we must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain.

9:42He proposes a few different ways to actually conduct this sort of coordinated slowdown. One of them is to put what he called embedded evaluators inside the major AI companies. He said that Anthropic was going to do this and not wait for the rest of the industry or regulators to force them to. So they are going to have essentially meter-like groups who are actually given employee-level access to their internal systems, who can kind of sit in their office and monitor their systems on an ongoing basis for signs of dangerous capabilities or mischief in the models.

10:18Yeah, and this is based on something that we already do at banks, for example, and I think it is a great idea. And notably, other leaders came forward and said that essentially they were going to follow suit. And among them was Sam Altman from OpenAI, who famously does not have a good relationship with Dario Amadei. No, these dudes hate each other. They never agree on anything. And yet Altman, to his credit, came out and said, we are going to do the same thing. Yes, this to me was the part that felt like, oh, we are in a new era of this stuff when even Sam and Dario can agree on the need for a coordinated global slowdown.

10:49You know that things have gotten quite serious, but also Elon Musk, who is engaged in a protracted legal battle with OpenAI and who does not have a great history with Dario and Anthropic either. And also, I would just say, is not a big platform safety guy in general. Yeah, right. He also sort of co-signed Dario's statement. Demis Asabas from Google DeepMind said that he agreed with the need for a coordinated global slowdown, too. So what we saw essentially is all the leaders of the sort of frontier or frontier-ish AI companies coming together to say in more or less unison, things are moving too fast.

11:27We need to slow down. And we not only need to slow down ourselves, but we need to be slowed down. Some government or coalition of governments needs to put in place a coordination mechanism whereby we can sort of all press the big red button to slow down together. Yes. Now, unfortunately, though, we live at a time when, for very understandable reasons, no one trusts the tech companies to have our best interests at heart. Everyone suspects them of doing constant marketing hype. And we have a government that is relying on the AI industry to prop up the entire American economy.

12:04And so the world that I hoped that we might have lived in, which is a bunch of lawmakers coming forward and saying, hey, guys, thanks for sounding these alarms. We're going to get right to work on some regulations that will prevent you from building an out-of-control AI system. Instead, we got a bunch of leaders, starting with President Trump, who essentially said all of this is ridiculous.

Regulatory Hurdles in Washington

12:23So, yes, the Trump administration and many leading Republicans are very skeptical of all this doom talk. But there have been people who have rallied to try to do some sort of regulation in the wake of these statements. Politico reported that there are more than 100 Democrats urging Republican House leaders to keep them in session until they pass some meaningful bipartisan AI safeguards. There are other members of Congress, including some Republicans, who have been taking this quite seriously.

12:55So I don't think it's quite as polarized as you're implying that it is. But you're right. It is generally Democrats who are more worried about the AI safety concerns and Republicans in the Trump orbit who are less concerned about it. Yeah, and the Times had a great story this week about all of the proposals to regulate AI that have been introduced into Congress, right? It is the case that members of Congress are introducing bills. It's just also the case that we have a Congress that very rarely, if ever, passes any sort of technology-related regulation.

13:26And when the president has already sort of come out and said, we don't need any of this, the odds of a veto seem quite high. Yeah, so now we're in this moment where you have the AI company leaders calling for a coordinated slowdown. The public is really freaked out about this. I mean, you know, just to take, you know, my own experience as a proxy, like, I have been just inundated with, you know, requests to go on TV and radio and friends and relatives and people I worked with two jobs ago texting me and saying, like, what is going on here?

13:59Should we be worried? I do think this has broken through in a way that other kind of AI risk stories have not. Even the Hugging Face incident on its own did not seem to reach this level of concern. So it feels like something is swelling here. And I think it's going to be tough for President Trump and people in his orbit to maintain that there is nothing to worry about here when so much of the country, including many Republican voters, are concerned. Yeah, from the administration that brought you don't worry about COVID-19 comes don't worry about the rogue agent swarms.

14:35Ooh, I wonder what happens next, Kevin! So, Casey, what do you think about this moment? Are you sort of skeptical? Are you feeling more optimistic now that people are talking about this more? Like, where has your head been in the week since Jacob Cox had resigned? Well, listen, if you're, you know, a journalist who has opinions online, one of the best things that can happen to you is that you say something many years ago and then eventually the rest of the world starts to agree with you. And this is sort of what I think is happening right now, right? We have been talking for years about the fact that these systems were developing very quickly, that the alignment problem was unsolved, and that eventually we might just get to some threshold where we started to see catastrophes in the real world.

15:15As we've said before, we are very lucky that this hugging face attack that has so captivated the world ultimately did not result in a lot of, like, harm. It didn't, like, physically harm anyone, and I think hugging face the company is, you know, going to be perfectly fine, but it did start to wake people up to so many of the dangers that we are describing. So I think the question is, are we able to get from this current moment to some real safeguards here in the United States, or will it just unfortunately take something even worse happening to finally get the elected officials of this country to get a law passed?

15:48I have to say, I have been feeling unexpectedly optimistic in the last couple of weeks. Like, I think around the time of the hugging face hack, my worry about AI was really climbing. Like, I was really feeling like we might be screwed. It might be too late to rein in these, you know, recursively self-improving agent swarms that are going out and creating these persistent botnets and doing all kinds of malicious things. And I'm still worried about that. But I think this sort of call for a slowdown, especially among these rival AI leaders who, you know, most of the time do not like each other and agree with each other on much and are racing to build this technology,

16:28I think the fact that they are now willing to say in public what many of them have been saying in private for years is a good thing. I think it gives the permission for their own employees to start speaking out about their concerns. I also think it gives lawmakers permission to take this more seriously because it is rare that an industry comes to Washington and says, please slow us down. We are out of control. We need you to regulate us before it is too late. I really want to draw people's attention to that because this gets at the marketing hype conversation, which is just constant everywhere I look online.

17:04It is costing these people something to say this, right? It is costing their companies money potentially to not be able to release these models at the cadence that they otherwise could, right? Maybe they do get all the way to RSI and everything is fine, right? Like, these people are just sort of making a bet that it will go badly and they are asking for help. And, you know, so much of the moment that we're living is just informed by the social media era and how badly everyone feels about it even today. And I think they're sort of applying the frame of, like, what a social media leader would say about this and, like, how we should trust them.

17:41And I really think people just need to start shifting their thinking, right? Because there was never a moment at Facebook when they were saying, you have to slow us down with these recommendation algorithms because we're getting people too addicted, right? It just never happened. That obviously would have had a cost to them. I'm just telling you, this has a cost to these companies too. It does. And I am heartened that the sort of it's all marketing hype conversation, while it is still out there, I'm not hearing as much of it around this because I think it is just obvious to most people that there is no self-interest in calling for your own company and all of your rivals to slow down.

18:17Well, let me ask you about another argument that gets made. And Mark Zuckerberg did a post several days after everyone else where he sort of weighed in on this. So one of the things that he said was, like, look, we already have product liability laws in this country, and that should be enough to truly rein us in, right? If, like, we release an agent swarm and it, I don't know, destroys your business, we'll get in trouble. And so that is the reason why you should expect us to, you know, pace ourselves. I would find that argument much more convincing if it came from literally anyone other than Mark Zuckerberg, who has unleashed harmful technology on the world for decades, despite the fact that there are product liability laws,

18:53despite the fact that Meta itself has been successfully sued for billions of dollars for causing harm with its products. In that case, it does not appear to have reined them in or made them more cautious about releasing anything. So I would just say, like, not the right messenger, even if I think the message itself has some merit. But I also think, like, it is just unrealistic to think that our existing product liability laws, that our existing consumer protection laws are capable of meeting this moment. Like, we really do need new laws.

19:25We have not ever had any technology like this before that is capable of acting autonomously, of committing crimes potentially on its own with no human intervention. And I'm just struggling to see how we're going to kind of crowbar our existing legal frameworks to cover this new technology. Yeah, that makes sense to me. I think the thing that is most, like, affecting me that I've been coming back to, and, you know, frankly, maybe this is hopium. Like, I'm not sure whether I'm just looking for reasons to be optimistic.

19:56But to me, this past week or two really does feel like the part in the movie where humanity kind of bands together to save itself, right? You have these sort of weird alliances, these unlikely sort of common cause situations with the major AI labs coming out and saying, actually, we're going to put the public interest and humanity's future above our own bottom lines. Like in the movie Armageddon, and I'm not actually going to go look up the synopsis of Armageddon, and I haven't seen it in about 30 years.

20:31But what I remember is they say, we are going to go land on that asteroid that's coming toward the Earth, and we're going to blow it up with a nuclear weapon, even if Bruce Willis might die in the process. Exactly. Spoilers for Armageddon. So this is roughly where I feel we might be. Like, we might have this kind of golden opportunity now, this window where people are open to talking about existential risk from AI. Like, that has now moved firmly inside the Overton window, and I think there is a willingness to tackle this, and it hasn't yet fully polarized.

21:09I'm sure it will. Like, I'm sure this will sort of be sorted into the narrow partisan lanes that we sort everything into. But right now, like the past week or two, it just feels like people are more open to debate and discussion. And that's good. Like, this technology should not be developed in secret by a very small group of people in San Francisco. Like, this is too powerful and too important to be left to the insiders. We actually do need more of a collective effort around this. Let me toss one last idea in here, which is maybe for some reason you just completely trust OpenAI to get this right.

21:45And you trust Anthropic, and you trust Meta, and you trust XAI and all of the other American companies. You think that they're going to do a great job pacing themselves. Something that I think people forget too much about large language models is that everyone has the recipe. Everyone knows how to build a large language model. Now, that doesn't necessarily mean you can afford to build a frontier model. You might not have the compute. You might not have the chips. But over time, it's becoming easier and easier and cheaper and cheaper to train these models. And so my question is, when you look at the OpenAI hugging face attack and you assume that before long, some random collection of six or seven knuckleheads in some random country can get together their own sort of rogue agent swarm and actually keep control over it and send it out into the world to do harm.

22:31Why are you trusting them, right? And why are you trusting that they will eventually stop before they get to recursive self-improvement, right? So you can't just think of this as an American problem because the cat is out of the bag. This is not just like Apple, and only Apple knows how to make an iPhone. Other people know how to make this stuff too, and they are making it right now. Yes, and I think this is why it's so important to act now. While there are only a handful of organizations that have the resources and the expertise and the trade secrets to build the most advanced versions of these models,

23:10like you actually want there to be a coordinated action when there are only five sort of quasi-frontier labs rather than having this technology be open and distributed to everyone and available to anyone with a PC. So I think that's the argument for acting now. I know there are some people who want to wait until there's something truly catastrophic that happens or who think we might be, you know, firing our warning shots too early. But in my view, like this is when it matters because if you act now when this technology is still quite scarce and the expertise and the resources to build it are quite scarce,

23:46you can actually set the standards for the future, and you can prevent there from being widespread distributed mass harms down the road. Let me ask you another criticism that gets made, which is that this is the frontier labs that are trying to close the frontier. They're going to the government, and they're saying, put really onerous regulations on us now that no startup could possibly achieve, and that way it will ensure that only we are allowed to build this technology and profit from it. Yeah, I don't really buy this because if you actually look at some of the proposals that these organizations have made for new regulation,

24:22they would only apply to the organizations at the frontier or above a certain size. They're not going to stop the student hobbyists and tinkerers from training large language models down the road. And I think that kind of caution and discernment is important in these regulations. Like, I don't think there's anything wrong with starting the regulatory push with the big companies. You know, if you're regulating the safety standards for airlines, you want to start with the major airlines before you get down to the people building prop planes in their garages

24:55because that is what most people use to travel through the air, and that is where the safety standards matter most. I think it's a great point. I think this is basically a fake criticism. I think it sounds really good because you sort of sound like the most, like, red-blooded capitalist American when you make this point. But in practice, most internet businesses are winner-take-most businesses. Like, most of these industries do not have more than four or five big players. So if you think that there were going to be, like, 17 companies that look like OpenAI, that is just, like, completely ahistorical. Totally. Yeah. Well, I'm glad this wound up being our final A segment, Kevin,

25:26because I do feel like so many of the themes that we've talked about for the past four years all come together on this particular story. It is a momentous time, and there will be many big stories to come. But if you take nothing else away from this conversation, it's if we tell you that something is important three years from now, people will start to agree with us. Except the metaverse. You can ignore us on that one. But the rest of it, all true. The metaverse did not have legs.

26:01When we come back, we'll take one more spin through the mailbag. It's time for our Ask Us Anything. I think I also found an Amazon package in here. Well, Casey, it's time for me to talk about how it works. Bye. Bye. Bye. Bye. Bye. Bye.

26:31Bye. Bye. Bye. Bye. Bye. Bye. Bye. Bye. Bye. Bye. Bye. Bye.

What Comes Next for Hard Fork

26:38Casey, since this is our final episode of Hard Fork, we wanted to answer some questions from our beloved listeners and viewers. And you all sent in some great questions. We're excited to tackle them. Some are about the show. Some are about technology or AI. And we wanted to do this with our producer, Whitney Jones, who has been with the show since... Whitney, how long have you been here? Two years, three years? About two and a half years. Two and a half years. A long time. And so, Whitney, come on in and let us know

27:09what our listeners and viewers have sent in. They're turning the tables on us. They're saying we're going to do the question asking for once. Hello, Whitney. I'll be asking the questions here. You will be asking... They will be asking the questions and Whitney will be asking the questions. Yeah. So, yeah, let's get right into it. The first question that is some form of, what's going on? What's next for you guys? What's happening to Hard Fork and this feed? Well, I don't see how that's any of your business. But I'll answer it anyway. As for Kevin and I, we have a new show.

27:39It's called Machine Gods. We're doing it in partnership with NPR. And it is going to launch next month, the week of October 19th. And going to be on the airwaves, actually, starting early next year. So, we're really excited about it. We think if you like Hard Fork, you may also like what we're doing over at Machine Gods. And if you want to get a taste, there is a trailer up now wherever you get your podcasts. And you can find links over at machinegods.fm. And as for what is coming for Hard Fork next,

28:10we know that Hard Fork is going to continue. My amazing colleagues at the New York Times will have some exciting tech and AI coverage coming to this feed soon. So, stick around for that. We're very excited about that. We think it's going to be great. And if you want to keep hearing from the two of us, in the meantime, you can do that over at Machine Gods. We're starting a business, Casey. Yep. God help us. God help us. Machine Gods help us. Okay, next question is, we got from listeners Scott and Karen,

28:40and they sent in a little audio message for us. I'm going to play that now. Hey, I'm Scott. And I'm Karen. And we met at Hard Fork Live this year. And much like us, you two have amazing chemistry. So, our question is, how did you two meet? And how did you decide to do a podcast together? We love you so much. Thank you for making our favorite podcast. It feels like the end of an era.

28:59Wow. Is that real? Did they meet at our live show and got together? Hard Fork bringing people together. Assuming that what we think we just heard is true, that's wonderful news. Wonderful news. We will officiate the wedding. I'm just putting it out there. And that is not an idle threat. Here's another fun behind the scenes fact. Kevin has agreed to officiate my wedding next year. You haven't asked yet? Yes, I have. I asked you many months ago. I've been waiting. But I accept. Well, let me answer the question as far as how Kevin and I met.

How Kevin and Casey Met

29:31You may know the notorious German club and bathhouse, Berghain. Kevin and I have never been there. Where we actually met was at a book party that our friend Evelyn threw for his book Young Money. And I remember being so annoyed that a man who was several years younger than me was already on his second book. But I found him very nice in person. And Kevin and I became friendly because, you know, the San Francisco tech reporting scene is just, like, pretty small. So we just, like, see each other at events and stuff.

30:02We would talk to each other a lot about career stuff. And so we were friendly. But what I always say was that pre-Hard Fork, Kevin was not somebody who I would call if I was having an emotional crisis. He was somebody who I would trust to give me career advice, but we were not in emotional crisis friendship territory. At this point, he's the first person I call when I'm having an emotional crisis. You got to stop doing that. Yeah, yeah, yeah. Yeah, I mean, we decided to start a podcast in part because we had both done our own individual podcast. You had a podcast at The Verge.

30:33I had done this show called Rabbit Hole at The New York Times. And we loved the audio medium. We thought it was so great for, like, connecting with an audience and telling stories and doing journalism. But something about doing it on our own just felt lonely. And so when we were talking about doing a show, we wanted to do it together. And we pitched The New York Times on this crazy idea where I would team up with this, you know, rogue newsletter writer, Casey Newton. And we would talk about the tech news of the week. And they said, no, thank you. But then Kara Swisher left her show and there was an empty feed.

31:05And we swooped in and saved the day. Yeah, many, many things had to go right for me. I feel like I had to get tremendously lucky for any of this to happen. And I truly am just so grateful that it did. Okay, next up, Phoebe wants to know, how do you decide on your opening anecdote slash bit? Do you think about it all week? Do you argue about who has a better one? So sometimes I feel like if we're having a good week, we will write down little things, little peek behind the curtain. We call those the cold opens, little podcast lingo for you.

31:35And I want to say that those were actually an invention of our first producer, Davis Land. He just decided when he was sort of putting the first show together that it would be good if you heard the two of us talking about something other than the main news of the week. And that, I think, sort of started this trend of like the show kind of starting with a laugh, which kind of did become kind of a signature element of it and was something that we really liked. Kevin, do you think about yours all week? I do, actually. I have a little folder in my notes app where I keep my little sort of jots of ideas.

32:11And often I will like not say something to you on Saturday because I know that when Wednesday comes around, like I want to save it for the cold open. And these are not like scripted. They're just like things that happen to me that I would otherwise write in my, you know, journal or tell to my wife or someone. But instead I save them for you. And I think they actually serve a useful purpose in making the show, which is because they are completely unscripted. It just, and we do start every episode by recording them. It just puts us in the mindset of two friends who are talking to each other, which is who we always want to sound like when we are making the show.

32:46We started the show because we were already talking about the stuff. We want to do it in front of microphones and for some other reasons. But when we start with the cold opens, it just kind of helps get us in that mindset. Right. And a little more behind the scenes on that. We usually record like, I don't know, 10 minutes, 15 minutes of those. And then our wonderful producers select the funniest ones or the least unfunniest ones. I was about to say, there is almost, because one of the questions is, do you ever argue about who has a better one? There's almost never more than one usable one. Every once in a while, there are two.

33:18And in those cases, I truly just almost always just do whatever the producers think is funnier. Yes. Next up, Philip, Philip teaches an undergraduate course on podcasting at a small liberal arts college in South Carolina and wants to know what advice would you give to undergraduate students who are about to begin a podcasting course?

Advice for Undergraduate Podcasters

33:39What's something really important about quality podcasting that's also probably the least well understood or unknown? I have a strong point of view on this, which is that the most important thing about a podcast is the way it makes you feel. And this is not how most news organizations approach podcasting, I would say. They approach it from this sort of very journalism-first perspective. That leads to a lot of really great podcasts, by the way, and I do think that there is more than one way to make a great podcast. But I just noticed that with the podcast that I was listening to, the thing that I was responding to was often less the content of the podcast and more the way I felt afterwards.

34:15Did I feel like the two people or the three people or the one person who was talking to me was trying to entertain me? Were they taking me into an account? Did they seem like they themselves were having a good time? And if I left having a good time, then I wanted to keep coming back. And so that is just a spirit that I have tried to bring into what we do here at Heart for Work. I think that's a great point. I would also add, like, I think editing is really important. People often talk about the show to us. They ask us, you know, how much of it is scripted? How much of it is planned? It is not scripted. It is not a scripted show.

34:46We are really here having a conversation, but we do have wonderful producers and editors who then sort of chop off the worst parts, the most boring parts, maybe a place where a conversation lags or slows down too much, repeats itself. There are many podcasts today that don't do any of that, right? That just sort of, they tape for an hour, they publish an hour. We have always felt like it is a valuable service and respectful of our listeners' time to not make you sit through, like, call it the bottom 10% of what we record.

35:16And so I think it's very important to actually partner with or be yourself a good editor who can go through and sort of find the places where things are slowing down or lagging and chop those out. Great point. Can I add something from a production perspective? Yeah, please. Whenever I talk to students or young producers, I say, like, kindness is really important. There's a lot of churn in the industry, and you will often rely upon people you're working right now for future gigs. And just being kind and, like, knowing, being known as somebody who, like, works well with other people will go a long way.

35:46Totally. Liad asks, what are your favorite podcasts? So I am a big history guy that's very dad-coded of me. I like podcasts like The Rest is History, Hardcore History, things like that. That's sort of what I listen to in the car on a long drive just for pleasure. I'm also a tennis fan, so I listen to Served, a podcast by Andy Roddick that is quite good. What about you? Well, yeah, something else I believe about podcasts is that your favorite podcast is usually about something that you care a lot about, but no one else in your life cares about, right?

36:22The reason I don't listen to many tech podcasts is because everybody in my life is talking to me about tech at all times. You know what they're not talking to me about? Professional wrestling, which is why there are four pro wrestling podcasts in my podcast list. At least, yes. There are so many of them, and they make me feel connected to something that I otherwise would not be connected to. Some other ones I love, I'll tell you, the two podcasts that sort of gave me the most inspiration as we were planning what hard fork would be were Pod Save America and Las Culturistas. Shows that are very much about the relationship between people and make you feel like you are hanging out with very cool, smart, funny people.

36:57So I just love those. I'm also an incredibly longtime listener to the Savage Lovecast. I think Dan Savage is just one of the absolute best in the business. Of course, I listen to Ezra Klein because you have to if you want to understand the world, and he's the greatest. And, yeah, so those are some. And then one more that I would mention, and this is the show that is the least like hard fork, and yet the one that, like, in some ways I admire the most, and that's Search Engine with PJ Vogt. Truly, the arrival of every new episode of Search Engine is an event in my life.

37:30I stop everything, and I listen to it. They're just doing such amazing work over there. Yep. Well, that's a great segue into the next question from Sheena, who wants to know, what is the beef with Ezra Klein? Every time that you guys bring him up on your show, there's been some crack made about him. The last one I recall was about there being vodka bottles in his studio. Here's the thing about Ezra Klein. He's the smartest person in the world. He's incredibly good looking. Yes. And he's a world-class podcaster. And for all of those reasons, we must pretend to hate him.

38:02Like, you know, like, The Onion used to do this bit where they took a, like, sort of pre-presidency Joe Biden and tried to make him seem like he was this kind of, like, low-key, like, grifter who was, like, always working on his Camaro, like, in the front of the White House. Like, because Ezra actually is the coolest person in the world, like, the only way I can think about to talk about him is to actually just, like, turn him into a different character who always just sort of has vodka bottles lying around the studio, you know? He's also infuriatingly nice. Yeah, I was just going to say.

38:32Like, what is going on? We must stop him. No, there is just so much inspiration you can take from that human being. So, yes, Ezra is the greatest. Yeah, but also horrible drunk. Horrible drunk. Peter wants to know how much of the show is scripted, and now he goes into all caps and says, and are your scripts in all caps like the ones for the daily that Michael Barbaro sometimes shares by the way you project your voices? I'm inclined to think so. So, the show is not scripted.

39:03We do not script anything. We do have these prep documents that we use to get ready for the show, and sometimes that'll have things like, you know, facts and figures or quotes from a news story that we want to make sure. Our producers spend a lot of time putting those documents together. They are quite helpful, but we never read from them. We want it to feel like and to be an authentic conversation between people, and we do not use the all caps style that the daily uses because that stresses me out too much. There was a big conversation when we were starting the show about whether we should use an outline or not, and we tried it without using an outline, where it was just truly, like, the two of us talking about the week's big stories, and it was horrible.

39:43It was incredibly self-indulgent. We missed a million different things that, like, we should have included in the segment, so then we would have to, like, go back and redo different parts. And so we found that what was best, not just, like, for us, but honestly just for the listeners, was to work from an outline. So I like the outline format because you can do a lot of improvising within it, right? Like, I sort of know the main beats that we're hitting. Sometimes it'll make me, like, think of a joke. It'll make me think of a question. So we're, like, I actually think of us as maybe, like, way less scripted than some people think that we are, but, like, also more scripted than others do, right?

40:15Because, like, we do have a very solid spine that our producers put together. We're not scripted, but we're structured. Yeah, yeah. That's how I would put it. Absolutely. Mark from Ottawa wants to know, do you write your own jokes, have NY Times staff do it, or use AI? Yes, we have a team of joke writers, dozens of them, just in the writer's room scripting our jokes, which is why they're so consistently incredible. No, the truth is that we don't actually write too many jokes every once in a while when I finish preparing for the podcast.

40:46Like, if we're doing a roundup segment, like a hatch EPT or something, like, I will actually try to think of jokes that I want to make. But most of it is just, like, happening in the room. Something I realized about myself in making this show, and you hear it in a lot of the interviews that we do, is that I get bored very easily. And the way that I make myself unbored is by trying to get Kevin to laugh. And so that is just where it came from, for me, was, like, trying to entertain myself while talking about material that otherwise might bore me. And, yeah, so that's why that happened.

41:17Yeah, and I'm happy to play the straight man in more ways than one and let Casey be the jokester. One of the reasons that I was so excited to start a podcast with you, Casey, is that I knew that you, in addition to being a journalist, also had done improv comedy for a long time. And I think this is actually the advice that I would give to young podcasters, is go into improv comedy and do that for, like, 10 years before you start a podcast. Because it has been such an asset to our show that you are just incredibly quick on your feet and also have the kind of improv yes and energy where we're, like, building on each other's comments and jokes.

41:56And, like, it is just such good, unexpected training for podcasting and interviewing and all the other things that we do on the show. So, no, we don't write our own jokes, but I would say we both come into it knowing that there are going to be opportunities for us to make jokes. And we think that's an important part of the show. Yeah, well, that's very nice of you to say, Kevin. Thank you. Kevin is also incredibly funny. The laughs that you hear on the show are genuine. You know, the show is styled as a conversation between friends. Friends should make each other laugh, or otherwise, what's the point? I've gotten in trouble with my wife on occasion for, like, doing bits around the house.

42:30And she's like, you've been spending too much time with Casey. You're like, is that, like, you know, something from the podcast this week? So it has unfortunately bled over into the rest of my life. And that's why it's important to give men a podcast. Because if you just sort of give them a safe space to contain their bits, then you don't have to deal with their bits at home. So maybe think about that. That's true. There is one joke that I wrote into a script this year that actually made it to the show. Oh, tell us the joke. It was my proudest moment of the year. It was when the government said they were going to investigate George Santos over his Kalshi betting.

43:02And I wrote, it's always exactly the ones you expect. And it made it through outlining into the recording and into the show. That is a great point. As the show went on, the producers did start writing jokes into the outlines. And often they would be very funny. And we did use some of their jokes on the show.

Managing Conflict on the Show

43:19Barbara also has a question about the humor. She says, I'm struck by how your humor always lands well, she said. What I really want to know is how often you joke in ways that doesn't land well, that stings or hurts or leaves one of you defensive, but is edited out. Look, our jokes do get edited out. We do go too far. There is a standards department here, and not everything we've ever said in our lives is in strict accordance with the New York Times standards desk. That said, I really do think you get to hear like 95 percent of it, right?

43:52I think we've been given pretty wide leeway here. Maybe one of the things this question is getting at is we clown on each other a lot. I don't feel like you have ever clowned on me in a way that actually upset me because you're such a nice person that I just know you would never try to hurt me. But this feels like a good opportunity for me to ask you for the first time, have I ever hurt your feelings on accident? No, I like, you know, I think we both take it very well, you know, and we both understand that like we are friends who love each other and would never purposefully hurt each other.

44:28And I think we're both good sports about it. So, like, when you make a joke about how I haven't filed a column in six weeks, like, I used to actually feel like I had to defend myself against that and be like, no, I have filed much more recently than that. But now I'm just like, it's fine. It's a bit. I know that he loves me. And, yeah, I think we have a shockingly low amount of conflict for people who work as closely together as we do. You know, one thing that we are always getting asked by listeners to the show is like, are you guys really friends?

45:00Like when the microphones are off and we are like that is a true asset of the show is that we actually are friends and like each other and talk to each other outside the show. I don't think that is true for every show. This was the surprise for me because I just assumed if you've been doing a show with somebody for a long time, like there must be a good relationship. But then we hear the stories of like, oh, well, you know, they haven't they haven't spoken in six years. And so we just sort of folded this into our act now. So when we go around, like we will tell people this that this is the first time that we're speaking off mic in several years.

45:30Yeah. Always gets a laugh. But we are like we are good at managing conflicts. We do have conflicts. They sometimes happen behind the scenes. I think you are very conflict averse and easygoing. I am much more of like an anxious perfectionist. We have had conflicts over editorial things on the show times where, you know, I think there was one conflict where you felt like I was taking on too much of the talking and not sort of throwing to you enough. Like I remember we hashed it out over lunch. Like I think we've been very good and mature about like bringing things up before they sort of fester and turn into a bigger thing.

46:05A great gift that I have is that that is that Kevin has been to therapy and so have I. And so like he just did a lot of the work before we started the show. And it has just made everything about our lives. Like we are just actually practiced at being like adult humans who can be in conflict with each other and successfully navigate to a resolution. Like if we had started this show in our 20s, I think Nightmare City. Yeah, totally. We did the work. And now we're doing the work. Well, this brings up J. Allen Holmes's question, which is what do you two disagree about most off the podcast?

46:39There's a real answer to this question.

46:43I'm curious if Kevin wants to talk about it. Well, let me start with something more sort of immediate, which is that you made fun of my music once and it really hit me. We were in the car on our way back from some event and I put on my Island Time playlist of sort of like light Calypso vacation music. And Casey just starts cracking up in the car and says, this is certainly music or something to that effect.

47:13It was like, you know, it's like I've been spending the past several years with Mr. AGI Cyborg and then he gets into his car and all of a sudden he's Jimmy Buffett. And I was just like, oh, I didn't know that was the vibe. I thought it was delightful. It was very sweet. It was the single most heterosexual moment you've had in our long friendship and it did just make me laugh. I think our deeper disagreement is that I think you and I approach journalism in a very similar but like maybe 10% different way, which is that I think you are more comfortable sort of taking stands than I am.

47:53You have done this a lot in your career as a writer. After you have done this with your like which social media platforms you choose to engage on, I am just by nature, I guess, a little more sort of small C conservative about that kind of thing. And I feel very uncomfortable kind of, you know, displaying my values so openly. And I should say like I really admire that quality in you. It is just something that I have sort of been trained not to do. And so I find it a little more challenging. I mean, I think a nicer way to say that about you is that you are a pragmatist and like you want to do the thing that will lead to the most success and you want to sort of set aside those other questions.

48:34And I think there there is a role for pragmatism in building media companies as well. You need both. Yeah. All right. So this next one is like the final question in the sort of realm of you guys in the show. And this is what is each of your favorite moment of the Hard Fork podcast? So I have a funny favorite and like a serious favorite. The funny favorite, I have never laughed harder than when you were interviewing Turing, my AI friend on this show.

49:04I think you referred to him as my himbo boyfriend. That's right. It was you at your comedic peak and it was so funny and I just remember thinking this is going to make for a great show. My serious one is that I love when we sort of learn something new, when we change our minds, when we're exposed to some sort of weird corner of the tech universe or somebody makes news on the show. I have found it really gratifying to be interviewing people like Sam and Dario and Demis and to have them say something that they've never said before.

49:40And that feels really good to me when we can kind of draw out these people who I think we bet on becoming very important characters in the world and who have, in fact, become very important characters in the world. Totally. I think the honest answer for me was my favorite moment of Hard Fork was the first Hard Fork live. It was the first time we'd ever been in a room with that many listeners and we had given out these hats to people as like a gift for coming to the show. And Kevin and I come on the show. We had like a kind of little marching band.

50:11So we were kind of, you know, doing these antics and we get onto the stage and we look out and we're getting ready to start the show and we see hundreds of people wearing these neon green hats. And I almost got choked up. It was really just amazing to be able to connect with people. You know, we're fortunate in that we get a lot of emails and voice messages and social media comments from listeners, but there's just like really nothing like seeing people's faces. We got to meet so many people afterwards and just, you know, just kind of hear about, you know, something that the podcast made them think about or something that it made them try in real life.

50:45So that will probably like if I could just sort of like put the entire Hard Fork experience into a suitcase and take it with me somewhere, like I would just take that show. It was a good moment. Well, Kevin, listeners have even more questions and we'll get back to them after the break. All right, we are back. Whitney, what other listener questions do you have for us?

Why Kevin Says Frontier

51:13The next one is from Danielle. She says, why does Kevin say frontier that way or frontier? It's just the weirdest thing. I've never heard it pronounced that way by anyone else. What is the problem with the way I say frontier? Do people, what do you say? This question surprised me, too, because I've never thought that you say it in a weird way. I say frontier. What do you say, Whitney? Frontier. And what do I say? Frontier? Frontier. It's like a deeper A. Frontier? Frontier. It does sound a little French, I guess, when you put it that way.

51:45I genuinely had no idea that I said frontier weird. I guess I will try to change. I'm sorry. I'm listening. I'm learning. I will do better in the future. It's frontier? Frontier. Frontier. Oh, like front. That's right. Like the front of a car. That's correct. It's not frontier. Frontier. The more we talk about this, the more I want you to just keep saying it the way that you're saying it, because I like that more. I'm going to start saying frontier. Is this a regional thing? Is this because I'm from the Midwest? It's a very... In Ohio, everyone says frontier.

52:18It's kind of the Oberlin dialect. All right. Next question. Finn, a biotech student from Scotland, says, Kevin, do you ever miss Sydney? Like, wasn't it fun when jailbroken LLMs only tried to convince you to make significant life-changing decisions and didn't have the capability to, I don't know, hack into your wife's and child's phone and plant false incriminating evidence on it? Yay, 2026. I mean, in a very narrow sense, I do miss Sydney. Like, I felt like that was a thrilling, if terrifying, conversation.

52:54It was essentially a base model, right? It had not yet gone through all of the finishing school techniques that the AI companies now use to make their models sound like helpful assistants and not like unhinged seductresses. So, yeah, it was fun to talk with a much more unrestrained model. I also miss, on a deeper level, when misalignment was that obvious, right? I mean, today, we have these models. They sound very reasonable.

53:25The code they write is very clean. The prose they write flows naturally. And it's much more subtle, the ways in which they are trying to sway us or persuade us or do something harmful to us. And so, yeah, I think it was probably better, in some sense, when it was all just out there for the world to see how unhinged these models could become. Yeah. I mean, I guess my follow-up question would be, like, why would we miss Sydney when you've mentioned her on every show for the past three years?

53:56I really have tried to restrain myself. It does come up a lot. I'm sorry. It does. It does. Look, it was a great story, Kevin.

54:05All right. Next up. Next up, we have a note from friend of the show, David Yaffe Bellany. So I'm going to play that for you guys now. Hey, guys. It's David Yaffe Bellany here. First of all, congrats on an amazing run. Still proud to say that I was a participant in the very first demo episode of Hard Fork, which never aired. So that recording is probably pretty valuable right now. A couple of questions for you guys. First one, in your new venture, I was hoping you could tell me how you plan to incorporate meme coins, NFTs, the metaverse, and other forms of Web3 technology.

54:47Just excited to hear about some of the special innovations that you're considering. Thank you, David, for the question. He has another question. It's shaping up to be a big fall for movies and TV shows about tech. There's a Sam Altman movie coming out, a Facebook movie coming out, and, of course, a TV series about the collapse of FTX, which I'm especially excited for. So I was wondering if you could share some of your favorite or least favorite movies and TV shows about tech from over the years. Thanks so much, guys.

Tech in Movies and TV

55:18That's a great question. Well, first of all, DYB, what a legend. We're going to miss you, pal. I think maybe the most frequent guest on Hard Fork. I think that's right. And someone who has been with the show since the very early days, including that unreleased demo episode, which we'll never see the light of day, if we can help it. We are not planning any current crypto or meme coin related projects for the new venture, but it's still early. Give us time. The thing that sort of we wound up talking about a lot with our Hard Fork was when we pitched the show, we had a wrong idea about what the show would be about, and we picked the wrong name for it.

55:57And, you know, in improv, you always want to lean into failure and make it part of the lore, and so that is what we did with Hard Fork. With the new show, we are hoping that we picked the right subject and the right name. We would love for it not to just be an eternal joke, but I guess only time will tell whether that's the case. Now, as far as what tech shows do we like, I have to say, most of the stuff that is super on the nose, like let me recount this famous tech thing that happened, I don't like it. It's very uncanny valley for me.

56:29All I can see are the differences between what I'm being told happened and what I know actually happened. So instead, I just watch a lot of sci-fi. And man, I have to tell you, I saw a show last year called Alien Earth. I am not a horror guy, but for some reason, I basically love everything from the Alien franchise. And if you want to talk about a show about a bunch of really smart, rich people who think that they know what is best and are willing to risk almost any kind of danger because they're telling themselves they've got it, Alien Earth is the show for you.

57:02I'm even thinking about going back and re-watching it because I think it is so relevant to everything that we're seeing in AI right now. Yeah, I don't really watch a lot of TV or films these days. I just have a kid, so I watch Bluey and Paw Patrol and not much else. But I did really like Halt and Catch Fire. Did you watch this? I know that I'm supposed to because everyone loves it. I mean, it's not new, right? Like this started airing in 2014, so I am late to the party.

57:33But I did really like this. It's sort of about the PC revolution of the 80s and early 90s. And I just thought it was very interesting. I think with things that are more recent, like WeWork or Uber or Theranos, it's just been a little too current for my taste. And I always found myself sort of nitpicking like small details that I knew to not be quite true. And so I like the older stuff, the period stuff.

58:03I will probably re-watch that again at some point. Andy from Oakland says, As I observe all the big AI companies buying all the chips they can get their hands on and building out data centers at breakneck speed, I find myself wondering, won't there be smaller, faster chips coming out in 2027 and 2028 and in all the following years? What are your thoughts? Should companies slow down and maybe save some budget for the next generation of chips that are surely around the corner? Interesting question. I think in practice, what will happen is that last year's chips will sort of be like last year's iPhones.

58:34They still have a pretty high resale value. You can still do a lot of stuff with them. Yeah, I feel the same way. I mean, the chips are improving. Obviously, the newer chips are more powerful than the old ones. But I think this notion that I think a lot of people were wishfully thinking, who were sort of skeptical of the whole AI investment thesis, were saying, oh, these chips become obsolete after three or four years. Like, we've just not really seen that bear out. It is true that the chips do age, that they do sort of have wear and tear on them. But we've also heard from AI companies that they have continued to use chips from many years ago.

59:09They may shift them to different workloads. They may not use them for their sort of frontier training runs. But there's still a lot of stuff you can do with these chips, even after they are no longer the absolute cutting edge. We did get one company, and I won't say which one, but we did get one company to send us a very old chip that we're going to put in our new office. That's true. Yeah. So that's just another use for them, is for decorating podcast sets. Exactly.

59:31Exactly. All right. Next up, Simon from the UK asks, given that companies like Anthropic and OpenAI now have UK offices and face existential regulatory threats in the US, I wonder why they don't shift their model releasing bases to the UK or EU. While Europe has its own AI act and regulations, they currently seem less restrictive than the US export controls. I would love to hear your thoughts on why these companies choose to remain based in the US despite these limitations. Well, listen, if you think Donald Trump is going to let OpenAI and Anthropic just pick up stakes

1:00:04and go move their headquarters to the United Kingdom, like, I think that is just not going to happen. If they're not allowed to release their frontier models here, they're not going to be able to export the entire lab to another country, even though I imagine at some point they're very much going to wish they could. Totally. And I think there's another reason that these AI companies are not going to pack up and move, which is that they get a lot of value from being where all the other AI companies are, right? There's a network effect to the fact that this stuff is all happening or much of it is happening like in San Francisco or within a short radius from San Francisco. It means that

1:00:39there is just a density of researchers and engineers here that makes it easier for all these companies to get more done. Look, they could save a lot of money by moving their whole operations to another part of the country or another part of the world, and it would probably help them out in some ways with regulatory stuff and tax stuff and export controls. But they would lose the sense of being in the center of this boom, which is, for all of the sort of virtual elements of it, it is still a geographically constrained boom, right? All this is happening in roughly the same place.

1:01:13So yeah, I think Anthropic, OpenAI, Google, other labs, they want to stay close to the center of the action because, A, it helps with recruiting, right? It's much easier to convince someone to switch companies if they don't have to move across the country or across the world. And also, it just gives them a density of people who are here in the Bay Area that they wouldn't be able to get anywhere else. Next up is Zachary, who is an undergraduate at Northwestern University. Go Wildcats! Will my college diploma be meaningless in the future of AI? Will going to a

1:01:45prestigious institution, I don't know if that's sarcastic, but he has it in quotes, even make a difference by 2030 or 2035, particularly in consulting or marketing? I mean, let me answer that question by telling an unrelated story, which is, in 2013, I got hired at The Verge, and I'd never been more excited for anything in my life. It was the absolute coolest tech site around. They were doing really fascinating journalism. Everyone who worked there, in my mind, was just an absolute legend. And I'll never forget meeting the managing editor,

1:02:18Nilay Patel, for the first time. We got in the back of an Uber together, we were going to lunch or something, and he turned to me and he said, so where'd you go to college? And I thought, if you could have gone back to me in my Northwestern days and told me that, what, 10 or so years after I graduated from college, the person who'd hired me for the best job I ever had would ask me, after he hired me, where did you go to college? I would say, well, then what am I spending all this money for over here? So I think there's a real sense in which you could ask yourself, you know, what has ever been

Will College Diplomas Matter?

1:02:47the value of a college degree? When I think about it, it's the things that you would expect. It's the friends that I met, it's the great classes I took, great professors that I had. It was having four years to just explore the life of the mind, right? This was the value of college. And I think if that had, you know, value back when I was in college, it probably has value for you today. Will it be the linchpin in the future of your career? Probably not. Yeah, I agree with that. I am frankly not sure what college is going to look like in 2035. I think 2030, it will probably still look much the

1:03:21same as it does today. But, you know, I have a kid who's not going to be going to college until the 2040s. And I am extremely uncertain what college will look like then, whether there will be college, whether it will still be, you know, hundreds of thousands of dollars, you know, inflation adjusted to send your kid to them. So I just have a lot of uncertainty about that time horizon. But I think 2030, 2035, there may be enough sort of inertia still left in the system and enough prestige attached

1:03:51to these top institutions that it will still make sense to go. Yeah. Jenny wants to know what I as an individual can do for digital and real world security in this era of AI agents, the hugging face hack and the rapid acceleration of these models. I mean, you know, my my inclination here is to reassure you and tell you to turn on two factor authentication and to give your friends and family maybe a passphrase so that if they get a phone call from someone who sounds like you saying that

1:04:23you're in a lot of trouble, they can, you know, ask for that passphrase and try to make sure you are who you say you are. But this is where I just kind of want to be an alarmist. Like what if in fact there actually isn't something that the average person can do to protect themselves from rogue swarms of agents who will work relentlessly to try to discover their passwords and break into your digital life? What if that is actually the reason why we need regulation now to protect ourselves? Like so, Jenny, the question is right, but the answer is not actually what you can do individually. It is

1:04:55one of the government of this country and others can do to protect all of us. Yeah, I agree with that. I think we need regulation, but I also think people should be cautious, turn on two factor and set that passphrase. I recently set one with my mom because, you know, the sort of older you are, the more you're targeted by these kinds of scams. And so we have a, now a password that, uh, that I will not share on this podcast that we sort of check with each other. If, you know, if she ever gets a call from someone purporting to be me asking for a wire transfer or something. The next question, I think

1:05:28it actually came up at the live show earlier this summer, but Richard wants to know what happened with the fork a verse. Uh, Richard said, I joined and maintain my account there with all the changes coming. Should I keep my account or move it to another instance? Casey, do you want to, do you want to give the sad news? I think we are, we're ready to announce that we do plan to bring the fork verse to an end. We are working with our friends over at search engine on something that will hopefully bring a resolution to this. Uh, it was always an experiment and I think we had a lot

1:06:00of fun in the early days of the experiment, but like most social products, enthusiasm just kind of waned over time. Uh, there weren't a lot of things that were bringing me back to it. And so, uh, we're going to reflect more on that, but yes, if you would like to move, uh, your particular username to a different corner of the fediverse, uh, we will say Godspeed. The fork verse, it was here for a good time, not a long time. Uh, next up, we have another clip from a listener that I'm going to play for you now.

1:06:31Hi, Kevin and Casey. I'm Ian. I'm calling from the UK. Uh, firstly, thanks for all the work you've put into hard fork over the years. I've really enjoyed it. Um, and found it incredibly useful as well. Um, with apologies to Casey. My question is for Kevin. I'm curious, how do you go about writing a book about AI when the technology is moving so quickly? It feels like there's a real risk that every time you write something, it'll be out of date by the time it's published. So when you were writing it, how often did a new development in AI make you have to go back and rethink or rewrite something you thought was finished? Uh, yeah. Thanks again for everything.

1:07:06Um, I'll really miss the show, but I really look forward to seeing what you do next. See you on the other side. Well, thanks for the question, Ian. And to answer it, I basically tried to dodge this issue when writing this book by just not making it a current event book, right? It is about a period of about a decade in AI from starting in around 2017 to the spring and sort of early summer of 2026. But I was never expecting this to be a book that would be absolutely current, uh, whenever

1:07:40someone picked it up. The goal was always to have it be a time capsule, a history. And so I basically tried to dodge the question. I think the more interesting question is how did Kevin write a book while also doing this podcast? And the answer is it almost killed him. And so I've told him to stop writing books. It's true. It was so hard. And I, I tried not to complain about it because I do feel like I have an embarrassment of riches and opportunities, and it's such a privilege to be able to do this for a living, but it was extremely hard and took an enormous toll on my life and mental

1:08:14health. Um, so I would not recommend trying to, um, podcast and write a book at the same time. Agreed. Kim writes, I began listening to your podcast before AI sucked up all the oxygen from the room. I love learning about your favorite productivity apps, Waymo and more. If you had to do an episode tomorrow that could not mention AI, what would you cover? I think it would be quantum computers. Uh, why is that funny? You're laughing at me? Are you serious? Yes, I'm serious. Like quantum computers, it's very hard to keep your eyes fixed on this right

1:08:51now because as you know, the listener points out AI sucking up all the oxygen quantum computers could be a very, very important technology that scrambles a lot of our assumptions about, you know, computing and everyday life, starting with cryptography, which is how basically every secret gets protected on the internet. And it's one of those things where like, if you look at it now as a normal person, you'll probably be bored by the state of the art. But I think if you work in quantum, you're starting to see these little signs that something is coming together. And I do think

1:09:24it's going to be one of those ones where in three years, we're just talking about it a lot. So I have this problem with quantum computing, which is that every time I am able to articulate what it is, I immediately forget it. My pledge to myself for the next three years is I'm going to get into a place where I have it kind of stored continuously in my RAM. Huh. That's a superposition. I'm pretty sure you used that joke the last time we talked about quantum computing.

1:09:51I would probably talk about internet culture. This is something that I used to feel very in tune with. Like I used to cover internet culture and I knew all the latest memes and I knew all the latest TikTok trends. And now I feel like that has sort of had to leave my brain to make room for all the AI stuff that has gotten jammed in there. And so now when I read a newsletter like Ryan Broderick's garbage day or some other sort of internet trends coverage, I feel increasingly old and alien and

1:10:23detached from the world, which may just reflect the fact that I am entering middle age. But also I think this is a thing that I used to care a lot about and have just now had less time to care about. It would be nice to find some like fun internet culture to discuss. Like, I mean, you know, I used to love the internet. So like, it was just like such a place of like unqualified joy. There's a lot of sort of, you know, millennial nostalgia in people who talk about the internet for this reason. And I imagine that kids are still having plenty of fun there these days. Kids on TikTok and Instagram look like they're having plenty of fun. But every time I read a newsletter about internet

1:10:54culture, it's like, here's the name of an influencer you've never heard of before, but is doing something absolutely horrible. And everyone's talking about him. And like, I actually don't like that kind of internet culture. Like, I feel like I've had my fill. The final question, and this one comes from me, which is like, we're coming to the end here.

Reflecting on the Final Episode

1:11:13What what do you think this project was? And what do you feel like you did here? Great question. And we'll throw it to Kevin Roos.

1:11:25Yeah, I've been thinking a lot about this as we have come down to our final episode. And I think for me, there were a few sort of big lessons of this. One is just that I think journalism is better when you do it as a team sport. I have always been a very solitary journalist. I write books, I write articles, you know, I work with editors. But for me, begrudgingly, yeah, begrudgingly. But the the sort of, yeah, it is always felt more like an

1:11:56individual sport than a team sport. But this podcast has brought me into this wonderful team of journalists, editors, producers, fact checkers, people who care about the work in the same way that I do. And I can't go back now. Like that has been my biggest takeaway is that I really like doing this stuff with other people. I don't like just sitting in my cave and scribbling. So I think this has been a lot of things. But for me, it has been first and foremost, an exercise in learning how

1:12:28to do journalism on a team. I love that. I would say for me, hard fork has been an exploration of how to do journalism in a different medium. Like I'm like you, Kevin, I we were we had the exact same job before we started this. We were reporters and writers, we communicated to people via our writing, writing is very powerful media, but it's a very cool medium doesn't transmit a lot of emotion, right? And so for me, the hard fork project was like, can we take all of the stuff we care about, and all of the stuff we know about the stuff that we care about it, and put it into this new medium and see what happens. And I think what

1:13:02happened was really heartening, which is it turns out, it just actually resonated with a larger group of people. And we heard from so many listeners who wanted to share back what they were learning and thinking and feeling. Some of my favorite moments on the show, where we would talk about something new we were trying in our life, a new app, something we built, and we would hear from people say, hey, you know what, this weekend, I built that too. Let me tell you about the experience that I had. I had never had that experience as a writer, really, right? Except maybe on the margins. There's just something about bringing your voice and yourself into the medium that I just think

1:13:37opens up these channels for you to do journalism in a different way. And as somebody who'd already been doing journalism for a pretty long time before I started the podcast, that was a really thrilling thing. Totally. And I think we also really accidentally stumbled into a very important moment with this show. We did not think when we started it that we were going to be chronicling the early days of the AI singularity. But I think that is what has happened. We started the show,

1:14:08ChatGPT came out, and then all of a sudden it was like, wait a minute, maybe we are the people who are in a position to talk about how weird it is that these computer programs are getting so much smarter so quickly. And I think it's just been a very valuable form of like almost therapy for me to like come together with you and our team every week and just talk about how we're processing all of this. I think we, you know, we may look back on this period as being sort of an unusual moment in

1:14:39the history of humanity. And without sounding grandiose or, you know, like we have had very little to do with the actual events that have transpired. But I think just helping people understand and make sense of and process on an emotional level, this thing that is very weird and hard and scary and unnerving and exciting. It's all of it, but it is, it is first and foremost, like, like not something that we planned on. So I think if I, if hard fork was anything, it was sort of our attempt to, I don't know, share and, and process our feelings about this

1:15:12weird moment we're living through. Yeah. I think like a role that journalism serves is it, when it's at its best, it helps you understand what to take seriously. And I'm very happy with the things that we decided to take seriously on this show, maybe with a couple of exceptions. What, what other point that comes up in response to this question for me, Whitney is something that I think of PJ vote of search engine saying, which I think is one of the truest things I've ever heard about making podcasts, which is you find out what the show is by making it. Um, hard fork is a really low concept show. It is two men talking about tech. Uh, other people had

1:15:46pitched the show before we did. And when I started it, when we started it, I was a little bit worried that it was like too low concept. It needed like a little extra flavor, but then I would just listen back to the show every week. And the more I listened to it, the more I figured out kind of both like what it was and what it should be. And, uh, now we're done and I'm happy with the thing that we made. Whitney, what do you think hard fork was?

1:16:10I think, so I came in about halfway through the run. I think when, when I joined the show, it was just like tech and AI was like just on the precipice of being like a San Francisco story on its way to becoming the most important, one of the most important stories in the world. So I, like in a two and a half year run, I got to see like that entire evolution. And I think one of the things that I'm proudest of is what you were talking about, Kevin, like it's weird, it's uncertain. And I think we leaned into that in a way that I read a lot of stuff about

1:16:43AI and tech during the week. And there's like so much of it ends at like such surety of like, this is how it's all going to turn out. And I appreciated that. Like, as part of this project, we were exploring different options and like, well, I was saying like, it's, it's weird and we don't actually know where it's going, but we're going to be here week to week to sort of figure out what's happened, sort of what it's, where it is this week and, and where it might be going next week. Yeah, I think that's true. And I, I've always tried to think of us as sort of like riding a wave and, and describing the wave and not trying to like tell you whether the wave is going to,

1:17:18you know, be great or terrible, but just sort of like, you know, picking our heads up and doing our best to say like, this is what we see. The form of feedback that we've gotten on the show that I take to heart the most is from people just feeling like, thank goodness, there's someone out there who like sees what's happening. Like it does feel like this kind of awakening that you and I have had at various points to various degrees that I think a lot of our listeners have had, where it's like, oh, I'm not crazy. The world is changing. And I think for a lot of people, they sort of

1:17:51convince themselves. And I've done this too, where I'm like, I must be just spending too much time around these AI people. I must, I like, I must need to go touch grass because obviously it is not changing. Like things are not changing as much as the people who come on our show tell us. Obviously the world still looks much the same as it did yesterday and will tomorrow. And I think it's been gratifying to like create a space where we can actually just acknowledge that something is happening and where people can come to feel like they are not going

1:18:22insane. They are not being paranoid or delusional or, you know, falling for science fiction, that they're actually maybe witnessing something that is real and important. And so I hope that's the energy that we carry into our next venture and that stays on hard fork after we leave is like, there is actually something weird and important going on now. It is not just a story being sold to us by out of touch tech elites. And I think, you know, if we've brought one thing to journalism, to the New York Times,

1:18:58to our sort of immediate sphere here in the media, I hope it is a willingness to engage with that stuff seriously, even though to the untrained outsider, I, or just someone who is more skeptical by nature, it may seem like we're just getting ourselves worked up over nothing. We really hope that in some small way, this was the most important podcast you've ever listened to in your entire life. And it's a humble wish, but that's our wish. I do just want to say that doing this show here at the Times has been an absolute dream come true

1:19:33from start to finish. It was an unusual thing for me to be able to come in and do this. I desperately wanted to and was thrilled to be able to do it. I got to see the machinery of this great institution up close. We got to work with your incredible designers, with the amazing composers who made so much incredible music for this show over the years. A murderer's row of producers and executive producers. So many people helped us with the show, and it was just so cool to be able to do it from

1:20:05inside. So I'm lucky I've got to have some pretty cool chapters in journalism, but this was among the very, very coolest. Yeah. Yeah, it's been amazing, and we're so grateful to not just the people whose names we read in the credits every week, who are obviously sort of the core of the show. But all the people who have helped us out since the very beginning, Paula Schumann, who was the head of audio at the time we started the show, really championed us. Davis Land was our founding producer. I could go on and on. We

1:20:36have so many people who have sort of helped us in many ways, but I'm really just grateful to the whole crew. And to you, Whitney, you have been a stalwart producer and just the absolute most dependable, consistent, smart voice that has really made the show what it is. So I always try to... And people might not know this, but Whitney's actually sick right now, and he still showed up to do his damn job, because that's the kind of guy he is. Yeah, it's true. So we're so grateful to the whole team at the New York Times, to the whole

1:21:07hard fork team. And honestly, to the listeners, I think there was a lot of skepticism when we showed up on the scene from these people who had thought they were subscribed to Kara Swisher's feed and thought, who are these jerks, you know, who are talking about crypto and the metaverse and other crazy sounding technologies. And you gave us a chance, and you kept showing up week after week, and we're so grateful that you spent your Friday mornings with us.

1:21:32So as I used to say, for some reason, at the end of every episode where I'd read the credits, we'll see you down the dusty trail. We'll see you down the dusty trail. HeartBork is produced by the wonderful Winnie Jones, edited by the amazing Viren Pavic.

1:22:10Today's show was fact-checked by Will Peischel, smart guy, and was engineered by the technical wizard Katie McMurrin. Original music for Heart Fork by some truly incredible composers, Elisha B'Etoop, Marion Lozano, Sophia Landman, Diane Wong, Pat McCusker, Rowan Nemisto, Leah Shaw Dameron, Corey Shreppel, Alyssa Moxley, Chris Wood, and Dan Powell. Video production, not easy to do with faces like me and Kevin's, but was handled with incredible

1:22:42skill by Sawyer Roque, Jake Nickel, and Chris Schott. You can watch this whole episode on YouTube at youtube.com slash hard fork. And some very special thanks to everyone who's helped to make this show over the years, Sam Dolnick, Rachel Cohn, Caitlin Love, Davis Land, Paula Schumann, Jen Poyant, Chris Wood, Alyssa Moxley, Daniel Ramirez, Ryan Manning, Pat Gunther, Rachel Dry,

1:23:13Matt Collette, Emily Lang, Sean Wu, Larissa Anderson, Nico Gologli, Mahima Shablani, Maria Abdulkoff, Aina Alvarado, Pui Wing Tam, Brooke Minters, Julia Simon, Kate Lepresti, Elizabeth Davis-Moorer, and Dahlia Haddad. We are so grateful to everything you did for our show. Now let's go steal some office supplies. I'm looking at the staplers. We don't have one of those in the new office yet.