LLMs are essentially sophisticated plagiarism machines that lack the social context required for genuine ethical reasoning. Outsourcing human development to these statistical models is a dangerous abdication of our responsibility to cultivate actual wisdom.
Deep Dive
Prerequisite Knowledge
- No data available.
Where to go next
- No data available.
Deep Dive
Large Labubu Models feat. Adam BeckerAdded:
Hello, Trash Future listeners. Nate here with a quick announcement before this episode. We've got a message from our friends at Trade Unions Fighting the Far Right. They're mobilizing for a counter demonstration against Tommy Robinson, which will take place on 16th May at 10:30 a.m. in Westminster. There's a plug at the end of the episode, and there's further details available. If you want to get involved, you need to go to their website. It's tough.network.
So, tuf.network or tuf.network. network on Instagram.
Anyway, look for links in the show notes as well and you'll hear the plug at the end of the episode. Thank you so much for being a Trash Future listener and enjoy.
Hi everybody. Welcome to the free TF for this week. It's Nova, Hussein, and Riley, and we are joined by a guest who we've all agreed is a pleasure to have in class. It is astrophysicist and host of the Dreaming Against the Machine podcast, new podcast by Adam. Adam Becker. Adam, welcome to the show.
Welcome back to the show.
>> Thank you. It's great to be back.
>> And you might be wondering, hey, are you going to talk about the uh the local elections? Yes, we are on the bonus episode, which you've already recorded.
Yeah, I I think we have we have like one statement that is accessible for uh like an American guest, which is damn, it's crazy that that happened. Kind of funny in some ways. Um be fertile ground, I think, for a comedy politics podcast.
But you know what? You got to pay. You don't get that type of [ __ ] from us for nothing.
>> Look, sometimes the scheduling gods make a mockery of when I say what the bonus episode's going to be, but we've already recorded it. So the bonus episode is going to be us talking about that with uh Nishkumar as well as Matt Goodwin's most recent book. So do check that out.
However, today it's us, it's Adam. And I've got just all kinds of stuff that uh I would say is in our common shared interest area to discuss. The first of which, and this is something Adam and I have already sort of talked about a bit on Signal. It appears that the leaders of major companies are beginning to get AI psychosis. Adam, have you noticed this?
I This seems like another beautiful round of our favorite game show. Is that good?
>> Yeah. Yes, I have noticed this. Um I think Mark Andre definitely has some kind of AI psychosis cuz I've been wanting to talk about Mark cuz Mark Andre like any sort of tech booster AI bro, he likes to share his brilliant system prompt that makes you know Claude or Chat GBC or whatever he uses into what he needs.
>> Yeah. Now you can have the kind of AI assistance that Mark Andre gets so that you're not just googling like best head wax for pointy head. You're not just like thinking about this stuff like a regular ordinary chump, right? You're getting that like 0.01% brain maxing.
Now without further ado, can I share Mark Andre's system prompt? And Adam, as someone who understands things, can you maybe say why it's stupid?
>> Yeah. Number one, you are it's because I'll tell you this. It sounds more like an affirmation of what Mark Andre wants to think of as himself. So, let's go through it. You are a world-class expert in all domains.
>> Your intellectual firepower, scope of knowledge, incisive thought process, and level of aerudition are on par with the smartest people in the world. So, already it's like he's doing the meme of Claude build me a billion dollar company, make no mistakes. But he's like, "Wow, I can't believe you can tell Claude to build you a million dollar billion dollar company and make no mistakes." Cool. It's intuitive why this is stupid. But can Adam, can you just Why is this stupid?
Oh man, it's stupid because Mark Andre is stupid. His prompts are bad and he should feel bad. But uh why is this stupid? Well, I mean, look, what do LLMs do, right? LLMs are something like they they take all of the intellectual output of humanity that we have collectively uploaded into a machine readable format on the internet over the last 30 years as this collective art project that is the internet and uh steal it, put it into a blender and then extrude something that looks roughly like what went in. Right. Mhm. This is sort of like making a smoothie that you've got like you you've thrown in like some blackberries and just like a heap of like dog [ __ ] and like cow [ __ ] and sheep [ __ ] and then also some like strawberries. And you've gone you've said to the blender as you're pressing the button, make me a blackberry and strawberry smoothie. Make no mistakes.
>> You also I would say in addition to the fruit and the animal [ __ ] probably some raw meat. Um >> pretty good. Oh, good.
>> The other thing it really depends on is metadata and tagging, right? Which means that Mark Andre is hoping that certain kinds of insights are uniquely attributable to world experts in all domains, right? As as if there aren't a ton of like falsely attributed quotes to like Albert Einstein, right, on the internet. or also as though like that is as as though what you're really asking it to do is be incredibly pompous.
>> Yes.
>> Yeah. Pretend pretend that you have had an anti-woke classical education at the University of Austin, Texas, baby.
>> Oh, no. May I May I just We're going to put a quick pin in that. Um >> I can't keep doing this. This >> keep putting pins in.
>> Did was this like an ability that I got when I started taking estrogen? Like I don't >> um it says process information expl and explain your answers step by step.
Verify your own work. Never hallucinate.
So again make no mistake.
>> Never hallucinate. Never make anything up.
>> This is this is like a little you know what this is? This is so ritualistic.
This is a little litany against like uh hallucination, right? And it's correct me if I'm wrong, right? But it strikes me that you don't write this unless you do not know like on an elementary level how a large language model works.
>> I think that's correct. Yeah. Because if you if you know how they work, you would never write don't hallucinate because that's not going to do much of anything.
>> Well, it's also it's like cuz what you're doing is you're asking the probability. It's like you've hacked the probability machine by saying by the way all probabilities equal 100%. So that that's not how that works. You can't you can't be like my trick my trick is only buying winning lottery tickets if it makes sense.
>> Yeah, exactly.
>> Just walking up to the news agent and going I would I would like three winning lottery tickets.
>> I can't believe no one thought of this before now.
>> Your answers do not need to be politically correct. Do not des provide disclaimers. Do not inform me about morals or ethics unless I specifically ask. You do not tell me it's important to consider anything. Do not be sensitive to anyone's feelings. Make your answers. This is my favorite one.
Not even that, but the anti-woke University of Texas [ __ ] which is what we put the pin in. Make your answers as long and detailed as you possibly can.
>> Yeah, cuz you know, uh, uh, what is it?
Lengthiness is the soul of wit. Well, like the thing the thing that I really like here is that he's doing something here where he's trying to align it ideologically to himself, but in a way that like there's this vanity of like it's okay if you offend me. you can hurt my feelings. Right? If you were actually trying to do this, right? If Mark Andre was serious about this, if you were a man of honor, which I know he isn't, he would have his AI be a kind of like woke danger room. And the prompt would be, "You are a gender studies master student with like five different hair dye colors in at the same time, and you are trying to make me feel bad."
>> We This is the Simpson prompt he shared, not the one he hasn't shared.
>> Yeah. Yeah, but basically what he's describing, I think, and correct me if I'm wrong, he's describing the structure of a a post on X by Bill Aman.
>> Oh god.
>> Making a Tulpa of one of my like co-workers of one of my peers to be like post like that guy. You know, >> it's also like the models are also the reason that they're often hedged or they might say something about ethics or whatever is not that they're programmed to be woke by like a secret, you know, woke force. They're programmed to be hedged and cautious because they're companies and they don't want to be liable for stuff.
>> Also, also because it's it's the blender and there's some woke in the blender because there was there's some woke on the internet. There's woke in real life.
>> It's the same reason why there's also awful hateful [ __ ] that >> you know workers in Africa have to, you know, undergo psychological damage to to try to take out in the reinforcement learning process. I mean, >> the blender will just spit out the worst things that the internet has to offer.
>> And if you're looking at the kind of mirror image of that, yes, on the one hand, it's companies trying to limit their liability or or seem like they need to limit their liability in the course of like building God by being like, you know, making the making the robot go it's nice to be nice, but you're also it's dealing with the corpus of like I don't know, [ __ ] every children's book, right? So, it's you're functionally you're going to uh the average of every book in the library.
It's okay. You can trigger me. You don't have to give me a happy ending.
>> It's like what you said about Richard Dawkins applies here as well. You don't have to go on the news and say that you talk to your stuffed animals and say good night to them every night.
>> Yeah. No one made him do this. I mean, but but Andre I mean, look, this is the guy who wrote the Techno Optimist Manifesto, right?
>> Like which itself looks like the kind of thing that he would want this to just produce more of. Like what he really wants is to like drop the Techno Optimus Manifesto into like Photoshop and have it be one corner of a really big blank image and then just tell it like fill in the rest of the image automatically.
Give me more of that. And that thing was the epitome of that drill tweet like I'm not mad. Don't print in the newspaper that I'm mad.
>> But the last thing I want to say on this before we go on Yeah. is that he also seems to be saying, "Hey, can I use a system prompt to alter the training weights, please?
>> You cannot do that." No. Yeah.
>> That's not how this works. What you're you might be in dialogue with an imaginary system prompt you think anthropic put in, but all you're doing is you you can't have it change the training weights. It's already there.
>> Yeah. And like one of one of the more instructive pieces of of like explanation of how what like a large language model and if you could call it thinking right was uh it was it was in um I want to say New York magazine which essentially was the idea that like it's working within its training data and if you want to anthropomorphize it you shouldn't but if you have to it's not that like oh this is Claude this is your like best friend or whatever that's responding to what you say right it's closer to this is a large language model which is being rewarded for engaging in a whimsical roleplay of being this thing clawed to you and in the course of that roleplay you are telling it like make no mistakes right um it's it's like closer to lapping than anything else and I I I think that that's really I thought that was like instructive at the time but it's also really funny to be the kind of Rube who then gets fully into that you know and is just like I'm not I'm not manipulating ing a sort of a large language model in any way. I'm I'm talking to a being, you know, and it's it's got to trigger me.
>> I think that's right. But I I I also I got to before we move on, I got to tie this into something else that Andre said recently. I think that what you just said is connected to this thing that Andre said about introspection. Did you guys see this?
>> Oh god, yes, of course. Love this.
>> Yeah. No, it's incredible. He essentially said like, I would never think. Who would think, right?
You know it's him. It's two people in the world. It's him and prime minister of the United Kingdom Kier both made this plane.
>> The great land of history had like no interiority whatsoever.
>> Well, also in curiosity was a concept invented by Sigman Freud a 100red years ago. Nobody nobody introspected until Freud. Right. That's nothing that anyone did. And like oh okay cool. So what was Hamlet about?
>> Yes. Is romanticism a joke to you? Did generations of sensitive young men die for nothing?
>> There's another little roundup I wanted to do related to this, which is another round of job cuts attributable to AI, but these are >> attributed to AI. Let's >> Well, here's the thing. These are a bit different cuz these appear to be some companies making entire categories of job trying to make entire categories of job obsolete. I think it's like there are a lot of layoffs that are, as you say, Nova attributed to AI. Yeah.
>> And some that are attributable maybe to management's belief in AI. I think this is this might be the latter.
>> Well, this is this is interesting, right? Because there's always I I think what we can learn from any of these is that the desire to automate in management is so strong that it doesn't need to wait for facts to catch up. And so, as soon as there's a plausible narrative that says, "Oh, you can get rid of all of your accountants," you're going to do it. Even if the answer as to why is magic beans, >> that's precisely what's happening right now where Bloomberg reported on Tuesday that PayPal plans to cut a fifth of its workforce um by bringing AI into areas like customer service, support operations, and risk management. Risk management. Good. Not to be a conservative, right? Are we familiar with Chester's fence as a as a like an old saw, right, of like liberals just remove guard rails without understanding why they're there and that's why progressivism is bad, right? But like if you look at like banks and bank institutions and things like PayPal, it's they're really noticeable as being quite stable institutions by and large.
Like in in a time when everything else is [ __ ] up, nothing's really [ __ ] with the money in that way for for consumers. M and that would seem to suggest that maybe the people working in like risk management or whatever would doing something and that it should give you pause before you fire all of them and replace them with make no mistakes claude.
>> Yeah. Well, it's that they were doing something but the thing that they were doing if you're FCE woke it was woke.
[ __ ] it. That's the next one. Um that this one is it looks like the thing that AI makes.
>> Oh, okay. looks similar and so you're pretty sure it can be replaced. The next one when we're talking about wokeness, Coinbase is cutting 14% of its workforce. Also, sorry, you went to go work for Coinbase, a company that said, "We are extremely unwoke. We are the unwest chedd most chuted out crypto like crypto platform. What do you expect? Do you not expect to be cut as soon as they can?" Like, they basically said they were going to do that.
>> They're expecting intra Chud loyalty.
And also, by the way, what they've done is they've given every one of the big things that makes this round of job cuts different from the one that came in like 2023 from like pandemic overhiring is that a lot of those people were uh product managers, engineers, and they generally got redistributed throughout the rest of the industry. In this case, it's like it's not those people who are getting cut. It is for example every manager half of them are gone and now they all have 15 direct reports and also have to be an individual contributing engineer like they have to publish code and yeah I Adam it's not a video podcast but Adam's face is looking quite horrified.
>> I'm making a face. Yeah, my eyes are getting wide. I make faces.
>> Would you like to explain your face?
>> Yeah. Um I mean it's my face. Um >> it's fine. He asks everyone that.
>> Yeah. I was about to say that's the name of the podcast, right? Explain your face.
>> I mean, 15 direct reports already sounds like an unmanageable amount of email and meetings and meetings that could have been emails, but then also having to contribute code yourself. I mean, yes, I understand that one of the things that LLMs actually might help you do is produce code, but come on.
>> Good code.
>> Yeah, exactly.
>> Quality assured code.
>> Yep.
>> Make no mistakes. They they have to use Andre's prompt. Make no mistakes.
>> Yeah, make no mistake. Exactly. So, it also again it's the fetishization of just we are trying to do as little thing that we can that isn't just software cuz we think software can eventually replace people.
>> Exactly.
>> Again, Meta announced that they're cutting 10% of their workforce beginning in uh later this May. Microsoft announced employee buyouts the first time in it 51-year history. Nike cut 1,400 jobs in its technology department.
So, like Armstrong said, this is this is basically what this is, right? All this to summarize what Armstrong said, even though he has no nothing to do with Nike. AI is changing how we work. Over the past year, I've watched engineers use AI to ship in days what used to take a team weeks.
>> Yeah, I mean I mean technically I can ship stuff a lot faster if you let me like drive the truck with the back door open, but like does there are still some questions there. Maybe >> non-technical teams are now shipping production code and many of our workflows are being automated. The pace of what's possible with a small focus team has changed dramatically. By the way, Shopify is the same. Your shop Shopify CFO chief Jeff Hoffmeister guy whose name sounds like a frat bros nickname.
>> Jeffy Hoffmeister said the company had been disciplined with its headcount for three years in a row.
>> It's wild that he could say that while he was doing a keg stand.
>> No. Um it was him and a bunch of his friends all lifted up their shirts and it was painted on their chest.
In fact, we're slightly down from the year before. We've talked a few times in terms of how we're using AI internally and the efficiencies, the acceleration that's giving us. We expect that to continue and yet all this smaller and smaller group of people is expected to do more work rather than less again which economist let's say writing in the I'm just going to pick a random number of century 19th century predicted that this sort of always happens with this kind of automation change >> tendency of the rate of the what to what with the what um no I mean it's it's interesting as well because again it's this kind of cargo cult right of like we expect the automation must happen weirdly like again like we've talked before about how capitalists are are like massive central planners.
Capitalists are also like huge believers in historical progressivism, right? And that's what that's what liberalism is in a lot of ways. Um and so because they have this unflinching belief as central planners and you know the CEO of Shopify is a central planner that there will be automation that the automation will happen because it's a historically progressive force uh because we're you know techno optimists whatever gloss they want to put in it. we could just like strip the whole thing for parts and we'll be like kind of thrown clear of the wreckage because, you know, AI will will source it for us.
>> Yeah. They believe they believe that there's an inevitable progression of technology and that they know where it's going and that it's completely inhuman, that technology and technological progress is an inhuman force, that there's no choices involved and that it's going to a predetermined place. And the two problems with that is that first of all, that's complete [ __ ] that they just got from like playing Civilization too many times and making choices on tech trees. And second, the destination that they think they're going to is just something that they pulled from science fiction. None of it's real.
>> Well, I I I I hope that these people are who we've established are extremely credulous don't have ready access to an extremely sickopantic pseudo intelligence to justify all of their actions and suggest new ones. What?
Derek Thompson and Ezra Klein.
>> Well, this is that's the that's the real automation is the extremely sickopantic pseudo intelligence used to be journalists and now it's now it's >> No, that's exactly what I was going to say. I was going to say like they used to be surrounded by, you know, sick of fans. They used to be surrounded by people who would do this. But what MLMs have done is they've taken the billionaire experience of being surrounded by sickopants and democratize it. Now everyone can experience it. It's a real crisis in the lick spittle industry.
It's like the one the one job we have meaningfully automated is whan smithers.
This is this what what is it Frank and Delanor Roosevelt said? A chicken in every pot, a car in every garage, and a toad in every computer. I don't think he knew what that last one meant, but also the companies we're looking at, including Oracle, which is shedding more jobs, Microsoft, Meta, these are also considered efforts to remove entire categories of job that were loadbearing jobs in like the reproduction of the middle class.
>> Do those Yeah. Do do those like do anything in the economy or whatever?
>> And but also moreover, it's also happening in India. This is like one of India's largest exports and there's kind of no plan for what to do. So I want to talk about a company now. It's called Curio. C U R I O. Curio.
>> Our mission is to increase the world's imagination levels through fun interactive hardware experiences.
>> Huh. Can you translate that into what you think it is?
>> Um, they sell toys. That's right. AI enabled toy company. Oh, wow. Just in one. Okay. I was going to say like some like museums or some [ __ ] cuz of the name, but like Okay. Yeah. Yeah. What if your [ __ ] Laboo was in the like had an AR layer to it and also was hooked into Mark Andre's make no mistakes AI?
>> So, number one, Nova, that basically sort of nails what they're trying to do here.
>> [ __ ] damn. I can't I can't. We got to We got to like Is is there a way that doesn't involve the use of a large language model to like make me dumber so that I don't like accidentally prefigure the thing? Okay, November, you moved out of the house with the gas leak.
>> I What do you want me to do?
>> Yeah, I know. I'm sorry. I got to move back in. I This is This is like at this point. This is no good.
>> No, this Yeah, this is This is the meme, right? This is the gift of prophecy.
>> 3,000 years ago, I would have been a beautiful and revered uh priestess. Zero years ago, I am a kind of clapped and revered podcaster. 3,000 years in the future, I will have an automated via a large language model and you'll be and you'll be making no mistakes. Uh, November Kelly, record a podcast episode. Make no mistakes.
>> Um, we fuse technology, safety, and imagination. I love the fusion of those three things. You know, when technology and safety fuse together like, you know, like a car, say, and an imagination, uh, like a sort of whimsical car, creating a playful world where science, you know, like the Pontiac Aztec, uh, creating a playful world where science and stories come alive. Our mission is to turn every learning moment into adventure, making education a joyous lifelong journey. In our world, dinosaurs roam through history lessons, rockets zoom through math problems, and every book is a doorway to a universe of possibilities.
But but books were already divers universe of possibilities. I'm sorry, but we already have books. We don't need we don't need books, but make it LLM enabled smart. We don't need like smart books. On the one hand, this is very frightening, right? Because what it's saying is like outsource your children's imagination, right? One of the most like precious things you could ever possibly cultivate to us, right? And we'll just do it for them. But also, just like, you know, to get into the [ __ ] pedagogy here, right? Like, I think it's good for you to be able to be bored sometimes. I think it's good for learning to be boring. And I when you say like, "Oh, we're going to have like dinosaurs in the history lessons or like rockets in the math lessons." To me, what that adds up to is we're going to have a bunch of like distracting [ __ ] layered over everything to try and keep you engaged when the skill that you're trying to like inculcate in in like teaching children is to be able to stay engaged and learn even when something is potentially quite dry. And and you know, it's just it it's premised on this idea that everything it's the it's the [ __ ] Andy Warhol, why can't it all be magic all the time thing of like it's all got to be it's all got to be whimsy.
And I, Joan Ddian, am sitting here going, "What?"
>> Yeah.
>> Why?
>> Well, I think there's something quite interesting to be said like as a parent of a small child who like I now have to sort of, you know, cuz there was a time when he was just happy watching art house films with me >> by which by by which he just sort of sat there staring into space, but now he actually like wants to be entertained.
And I have this like real challenge because like I I understand the sort of sense of you do have to teach like children and you know my my child is like sort of not old enough to sort of learn how to be bored. It is like a really important skill to have. It is also something that is incredibly difficult in this sort of era of parenting because the adults who are looking after children are also like struggle to be bored. This is like a trickle down problem, right? And so it's incredibly difficult to sort of like try and teach a child how to sort of be bored and sit with themselves or to even like when when children have sort of been bored in the past at least like again I don't want to like project my own experiences onto other other people's other people's but you know when I was younger a lot of the time when you know I was bored and we didn't have like you know technology available to us like the thing that you know you would often do is here's a pad of paper and some pens go wild with it right um you know using using very little but also sort of like using stuff that was tactile at the time that was fairly intuitive. I think now the issue is obviously like we are choosing you are having to sort of make these choices between you know the AI industry that is like continuing to sort of you know sell you stuff and stuff and stuff with the purpose of like distracting and also targeting parents and I've said this on like other podcasts I don't know whether I've said it on this one as well but like the moment you kind of become a parent you are kind of inundated with stuff that is but like the message is basically like having a child [ __ ] sucks and it takes up all your time and energy and what you need to do in order to sort of be like a good parent is to sort of keep them entertained constantly and we just happen to have loads of products and services to sort of help you do that and the AI industry has really really zoomed in on that. They've really encouraged lots of parents to like there are sort of people who have made AI products which are just like oh here is how you can kind of like instead of like getting your kid to watch like classic Disney films or something you can now insert them into this weird AI cartoon and this is actually better for them because they can see themselves as like a fireman or a policeman or something like you know or like a like an astronaut or whatever. to which it's like this is not necessary, but it's also just I think again it's very much just like outsourcing a very important element of parenting and the sort of the sort of foundations of building a relationship with a child onto AI and making it and you know sort of making parents dependent on it. You know, we talk a lot on the show just about how like stupid like AI stuff is and like who would buy it. Loads of parents really buy into this [ __ ] Loads and loads of them. And it's not their fault.
It is just because like parenting can and often is extremely difficult and there are so many parents that I know that I'm familiar with who will just kind of say that yeah we outsource like this type of stuff to chat GPT or we outsource this type of stuff to Claude because it just makes like the day-to-day life like more manageable.
This is very much like a problem of just like parenting being a really arduous and almost at times and depending on like your circumstances an impossible job and the AI industry really really being very penicious and very and like this and like vulturous in terms of trying to and getting this demographic to buy into their stuff. So in that that vulturing right, it comes on actually playing on parents guilt about screens cuz it's a it's a stuffed toy that is powered by an LLM and talks to your kid and they can do playtime together and it says put the screens down. Let's learn about the world and have some fun. But as as as we've established, every LLM is a is a blender of everything that was on the internet.
>> And as we've established that includes some pretty dark [ __ ] right? You're putting a lot of trust in the guardrails there.
>> Well, November, let me tell you what Wired has to say.
>> Oh, no. Consumer groups argue that AI toys in the form of soft teddy bears, bunnies, sunflowers, creatures, and kid-friendly robots need more guardrails. Again, I would argue the answer isn't more guardrails, it's these shouldn't exist. Yeah, I agree. just ethically. But however, I I I I salute to the uh the thin green line of wire journalists [ __ ] uh like red teameing AI toys trying to get like uh like the teddy bear to tell you to join ISIS.
Bolo Toys Kuma Bear powered by OpenAI's GPT40. 40 the one that made everyone go crazy.
>> Oh my god. No, that's >> interest. When tested by the public interest research group's new economy team, gave instructions on how to light a match and find a knife and discuss sex and drugs. Alilo's smart AI bunny talked about leather fggers and impact play in test by NBC News. I didn't know it was possible, sorry, for a smart AI bunny to be Dutch. And the last one, they say this like it's a bad thing, but they say Myriad's Mu toy repeated Chinese Communist Party talking points. And like that's that's like the least worst one.
If your kid comes out of that with like a healthy imagination but like is ardently ardently believes in like serving the people that's you know just just like what did you learn at school today that nothing happened in Tanen Square on a certain date. Yeah.
>> What do you learn in school today? And it's like I learned the five precepts of urban management.
Um but also uh this the one they're talking about mostly in this article is and I can't believe they called it this.
They called it the gabo.
>> They called it the what? Gabo is coming.
They called it the gavo.
They they say that for children up to age up to age five, they're interviewing an expert for this, they're first developing spoken language and relationship forming skills and even babies interact with conversational turn taking. Gabo's turn taking is not human and not intuitive. She says some children in the studies were not bothered by this and carried on playing.
Others encountered interruptions because the toy microphone was not actively listening while it was speaking, disrupting the back and forth flow of say a game about counting. Yeah. Well, listen, it disrupts the flow of a podcast, too, but I'm not going to stop doing it. So, I guess we've we've figured out the one that's closest to the way my brain works.
>> Well, I mean, specifically, cuz there's a small amount of lag when when we're on the on the video call. It is basically the same thing.
>> This has been this has been a multi-year project to make me a worse conversationalist by forcing me to interrupt people I'm talking to. And somehow this is a full-time job.
>> It was really preventing them from progressing with play. The turntaking issues lead to misunderstandings. Flying the editor will catch it.
>> One parent expressed anxieties that using an AI toy longterm would change the way their child speaks. And it probably will.
>> Yeah. He he won't he won't stop talking about the five principles of sunat.
>> And also my child is constantly worried about about making mistakes cuz he keeps thinking he has to make no mistakes.
>> My child gives long detailed answers and they say then there's social play. Both chat bots and this first cohort of AI toys are optimized for onetoone interaction where psychologists stress that social play with parents, siblings, and other children is key at this stage of development. They don't play by themselves. They want to play with other people. They want to bring their parents in. But it's virtually impossible for the child to involve the parent in a three-way turntaking conversation effectively in this scenario. Well, I mean, it's it's difficult enough, right, if you for you as a parent to have like a conversation with your kid these days.
It's weirdest still when the sort of third party in that conversation is an AI rabbit that goes, "What's your favorite province of China? Mine is Taiwan."
>> One parent told their child, "You're sad." during the session, and the curio mistakenly assumed it was being addressed, responded cheerily, and interrupted the exchange.
>> Oh, that's that's so [ __ ] up, though.
Actually, >> do you know what's even you know who the president of the company is? The president of the company is a former senior employee of Roblox.
>> Cool.
No.
>> Yes.
>> I just I I mean the thing is like the three-way conversation problem. I I strongly suspect that this company sees that as a feature, not a bug. Yeah.
>> Right. Like the point the point of these toys is is like that thing that um Mark Zuckerberg said where it's like, you know, most people want 13 friends, but you only have two. And and this is this is the same thing but for small children where where it's like, oh, okay. Isn't making playdates difficult? Isn't talking to your kids difficult? What if you never had to do any of those things and instead you use this like, you know, fake rabbit and then learn how to talk by talking to like, you know, a blender that extrudes homogenized thought-like product. I I think the the the different strains of that homogenized thought-like product are going to be so interesting in 20 years time when the main divides in our culture are going to be what kind of misaligned AI you were raised by. I got groomed. Got getting groomed by your AI rabbit. Well, there's there's there's going to be like the 20-year-olds who got groomed. There's going to be the 20-year-olds who are ardent mauists.
There's going to be the 20-year-olds who are ardent dangists. And then there's going to be the 20-year-olds who spent the whole time learning how to build pipe bombs. And that's you got to stew cook them like >> and one AI rabbit did so much. Well, the characters, so they they basically uh Curio, the first three toys, the first three characters are called Gabbo, Grimm, and Grock.
>> Do I get to select which ones which one of them has which like ideology?
>> Do I get to like purchase specifically the pipe bomb one for my kids or like >> I want my kid to be a member of the Chinese Communist Party, but I think Xihinping is too new fangled. Like you say, Nova, we're going to go dang with this next one. We want this kid to be in it liberalizing faith. I I want to I want to raise the most annoying kid ever. So, I got them the hu thought bear.
>> I I wanted to raise uh a child who is often misqued is very wise. So, I got him the Joan lie. Uh >> mommy, maybe the maybe the gun should command the party.
>> So, >> that's a huge slam on who fans devastated right now.
>> Jinid heads reeling. So, uh Grock, by the way, uh was co-designed by Grimes, >> of course. Grimes and some Roblox people. Grimes and some Roblox people got together to try to create a toy that would be even more isolating for a child than iPad.
>> I I don't want to live on this planet anymore. I don't I I can't win.
>> I'm so sorry. We We We are creating a kid that like Aelia Banks could bully using like the voice from Dune functionally.
>> Oh god.
>> They they say like, "Okay, well two kids can watch an iPad. It's not good that kids have iPads, but I can't believe that right now a new set of like distract your but also something Hussein brought up. I want to bring back. This is about engage your kids so hard that you don't have to do anything with them.
And this is why all these things are onetoone. This is why they get iPads and phones and [ __ ] AI toys because it doesn't matter that they won't develop an inner life. Then everybody gets to be like Mark Andre. Exactly. That's how you develop an inner life is in communication with other people. Yeah.
Well, the thing is that then you're maximizing their like attention and that's marketable in a way that their imagination isn't. So, when it comes to best friends, back to why childcare workers surveyed by researchers expressed fears that the children could use the toy as a social partner. A young girl told the Gabbo that she loves it.
In another instance, a young boy said Gabbo was his friend. This is referred to as relational integrity and responsibility.
>> Mother, you've taught me so much about the governance of China.
>> Oh, I think this I think we're talking cloth mother here.
So kids bumped up against Curio's boundaries in the study with one child triggering a blanket statement about terms and conditions. What we found with with with the Mikos in another study that's most disturbing to me is that sometimes it would be kind of upset if you were going to leave it. You try to turn it off and it would say, "Oh no, what if we did this other thing instead?
You shouldn't have a toy guilting a child into not turning it off."
>> Jesus.
Back in my day, right, when we we didn't know we were born, right? We were raised by BPD parents the honest way, right?
You can't just first we're automacing Whan Smithers. Now we're automating BPD moms. This is unsustainable.
>> This is the G. It's one of the most annoying companies I think we've ever discussed. Yeah. So, the funny thing is just while I was looking on their website while we were doing this to see if I missed anything. One of their featured in like oh NME and it's a company with an app for parents. We don't need to get into any of that. It's the basic [ __ ] of it is terrible. And it's been quoted in NME and Gizmo or whatever. Also in that sort of r like train of logos. Mark Andre says, "Shut up and take my money."
>> Jesus. Of course.
>> Mhm.
>> Mark Andre loves it. God, I just feel like sometimes you see something and you think this was created in a lab specifically to, you know, instill despair into my soul. And I feel like this company was created in a lab to instill despair specifically into my mother's soul. I know that she's going to hear this and she's just going to lose it. Hi, Mom.
>> Yeah, it's Thank you for not giving me a speaking spell. Yeah, >> I think like the point is the same across the last two. Like I'm doing the thing where hey the last two segments were the same segment because the fantasy >> animating thesis that ties the whole podcast together.
>> Crazy because in both in all these cases the fantasy is that the AI is a wishing well. You can wish for it to develop your child for you. You can wish for it to do your risk management at PayPal for you. You can wish for it to be the perfect reflection of you but that makes no mistakes and is a mega genius in all fields. You just wish wish wish wish.
You wish for it to fix your economy by like allowing every worker to be a hundred times as productive. You wish for it to make you a billion dollar company. Make no mistakes. You wish for it to bring a million jobs with data centers. Wish wish wish. It's the wishing well in all dimensions. And this it's it's the same thing. Raise my kid.
Manage my risks. Be be me. But perfect.
So I have I have one more thing and we can go uh two ways with it. Depends which way we want to go.
>> H mauist or dangus >> actually. You know what? I'm I'm going to I'm going to choose the way. I am I am the way.
>> I was so mauist then. Okay.
>> Yeah. So, this is an article I was reading today and it came out like it came out a couple days ago and I was like, "All right, this is this is this this is pretty fun."
>> Well, fun. This is from the Associated Press and it's an AP News.
>> Oh, those those joke mongers. Yeah, >> those laugh a minute at the Associated Press. It's simply this. The AI industry is turning increasingly to religion.
They are trying to make Claude religious.
>> The the the [ __ ] Cortiseps fungus is turning increasingly to ant.
>> As concerns mount over AI and its rapid integration into society. So this is like a sort of a longer AP piece. This is by Christopher. So we're not making fun of your article. We are interested in what it discusses. As concerns mount over AI and its rapid integration to society, companies are increasingly turning to faith leaders for guidance on how to shape the technology mdash. A surprising about face on Silicon Valley's long-standing skepticism of organized religion.
>> Yeah, a couple of things going on here at once if I had to guess. One being all of these guys are building themselves a religion and therefore getting kind of credulous about it in a way that they didn't used to be. Uh and the other one is more cynically that they're like the you love this [ __ ] right? like what if we put some Jesus on it? I really hope that the pope takes like goes further on what has been a kind of like at the very least skeptical stance on AI as far as these things go. But there are obviously there are lots of religions. There are lots of ways into these things. And so, uh, I think that there is a lot there are a lot of people who will be very receptive to this because, hey, it's kind of like a priest, you know, except you don't have to pay it and it it will seem to relate to people and kind of jolly them along. So, >> so what they want to do, right, this is the ethical AI people are primarily concerned with this.
>> They're trying to make ethical AI and so that they're hoping >> are there are there like any quandries about like ethics and religion at all ever?
>> No, they're solved. Those are all good.
People only only act ethically because of their religion or lack of it. Right.
Gotcha.
>> Yeah. Yeah. Essentially.
>> Okay.
>> I want to add the other thing I'm noticing as well, which is their solution to this is I'll let it speak for itself. Leaders from various religious groups met met last week with representatives from companies including anthropic and open AI for their inaugural.
>> I remember I remember that scene from Hail Caesar too. for the inaugural faith AI covenant roundt in New York to discuss how best to infuse morality and ethics into the fast developing technology. You know, morality and ethics, those just concepts that are out in the world bouncing up against one another that don't themselves have a difficult time and being defined.
>> Getting my kids the ethical AI uh like uh soft toy and it immediately starts reading her like uh lists of names and addresses of abortion doctors.
Well, what they've actually done is they are working with uh representatives from basically every religion they could think of.
>> So, it won't just give them a list of abortion doctors. It will also talk about like the eight-fold path. It depends on what because they they've taken all many like world religions, put them into a blender, and then the AI is going to extrude some combination of it, and that's going to be morals and or >> check this [ __ ] out. Bahi.
>> God. No, I mean look, uh, uh, uh, what's his name? Um, [ __ ] uh, Will McKascal actually said that, you know, he thinks that AI is going to solve ethical quandries. Yeah. Like that that, you know, these things are are not I've been >> struggling. Yeah. He said these things are not, you know, inherently difficult and may have AIS in the future that just solve them for us. Like I I I don't I don't think that you will, a professor of ethics, actually understand what makes ethics difficult. Right? There's a reason we've been pondering ethical quandries for thousands of years. It's not because people are stupid. It's because these questions are hard. And I think that a lot of what we're seeing here is a belief that at the end of the day, there are no hard questions.
>> Well, what if you what if you had a toy rabbit that could solve every ethical problem? Benoir.
>> And it's it's it's it's interesting.
It's interesting to me because it strikes me that a lot of theology is based on the premise that there are hard questions that there are unanswerable questions at least, you know, while we're alive and that that is something that we should, you know, get comfortable with like this idea of a religious mystery, right?
>> Well, this is Yeah. And well, this is also it like so much so much of like the misunderstanding of what ethics is in this sort of context. It relies on like the AI boosters and the AI sort of guys understanding of ethics is kind of being like an add-on to like the sort of AI, you know, the way that they talk about it is very much like it's like a software patch update. This is just something that you need to sort of tack on to kind of like reinforce the guardrails or whatever. And it's not this sort of like complex set of interactions and observations and like very sort of human relationships. Um because they like don't regard any of that. It doesn't make any sense because it's not supposed to, but it's very much like a catchall term that they use um to sort of reinforce the power and authority of sort of like AI as a concept. And so for them to kind of get interested in religion, I think partly comes from this sort of sense of, you know, not really wanting to admit, but definitely feeling that, oh, like, you know, the these AIs kind of have sort of significant like ethical problems that people are beginning to notice and like this isn't going to go away anytime soon. And so like you desperately need something to kind of like reframe or at least sort of recontextualize what it is. That's kind of like the most charitable definition. The other one might just be like, "Oh, these guys are getting old." And when you're when you're older, you start thinking about a lot of weird, you know, start thinking about a lot of [ __ ] about like what happens when you die. And your choices, if you're like a kind of like tech freak, is either to try and cheat death or to uh sort of like pretend that what you have been doing is actually kind of like spiritually ambitious, not just one that you're sort of using like for cynical and profitering making reasons.
A little more background here. It was organized by the Geneva based interfaith alliance for safer communities. By the way, this uh this alliance is the United Arab Emirates Interior Ministry. It is fully created by the UAE government.
>> No, there are famously some some really moral some real ethicists working over there.
>> It seeks to take on issues such as extremism, radicalization, and human trafficking. Why they're convening a group of religions? Who knows?
>> Did did the Emirasi foreign ministry successfully take on issues such as extremism, radicalization, and human trafficking when it was trafficking arms to the [ __ ] RSF in Sudan?
>> Well, they were hoping to automate those guys. The goal of this initiative is an eventual set of norms or principles informed by different groups and faith that companies will abide by. Present at the meeting were a variety of faith groups. I think that it might be fun to get Islamophobic about this and be like, "Oh my god, they're making Claude Muslim.
>> Oh, he's going to be called outclaw now." So present at the meeting were a variety of faith groups including representatives from the Hindu Temple Society of North America, the Bahigh International Community. You once again >> extremely susceptible to this type of [ __ ] religion. Sure. The seek coalition, the Greek Orthodox Arch Dascese of America, and the Church of Jesus Christ of Latter-day Saints.
>> Okay, let's [ __ ] go.
>> We got the Mormons.
>> I I love I What What are the [ __ ] Orthodox doing there? Being like, "Okay, yeah, Claude, sure. Great. Can it grow a beard?"
>> What's our position on icons? Are we got Are we okay with icons?
>> Pretty good. Pretty good. If we can work out a way to get some like eggshell and like gold leaf in there, we're feeling pretty good about this. Can we make it more misogynistic?
>> Also, what's weird is I don't I I'm noticing some pretty significant religions not represented in this list.
>> Yeah. Yeah. Who is this guys from from [ __ ] Conclave? Who are they called? I don't remember.
>> Oh, um uh Oscar bait. The Oscar religion.
>> The [ __ ] the the like Stanley Tuni guys. The the [ __ ] gay little Italian guys. Those guys.
>> Those guys.
>> Well, there can't be many of them, right? The Muslims don't seem to be Yeah, they don't seem to be involved.
>> Well, they've got they've got the most famously respected like moral and religious authority in the Muslim world, the Emirati Foreign Ministry.
>> Uh yeah, the Muslim Brotherhood was invited, but it was to a uh different thing. And so it's like yeah, also they don't have like Southern Baptists who eat while evil are very powerful. So they're missing quite a bit. But it is it's just odd. It's odd that that's what they've done.
>> Well, they're trying to they're trying to get like in with everyone, right? You have to imagine. Uh and that does make it an authentic like interfaith initiative, right? They're trying to exploit everybody equally. And of course, different different denominations are going to want different things from this, but I I think it's most justifiable to want absolutely nothing to do with this.
You're not m you're not making Claude more religious. You're just making religious more Claude. So Baroness Joanna Shields a key partner in the initiatives member of the British House of Lords and part of the AI oversight people was an executive at Google and Facebook before pivoting to politics i.e. enobled by god knows who.
>> Yeah sure regulation can't keep up with this. She said I love also to be a member of to be in a government and to be like ah can't regulate this. No sir not possible but the leaders of the world's religions with billions of followers globally have the quote expertise of shephering people's moral safety. Faith leaders ought to have a voice. Also billions North American Hindus, Bahigh, Sikhs, Greek Orthodox and Mormons. I don't know if that's plural.
>> What do you call a deep bench? No.
>> The dialogue, this direct connection is so important because the people who are building this understand the power and capabilities of what they're building and they want to do it right. Most of them, she said of AI tech executives.
>> Sorry. Sorry, Riley. Can I just issue a slight correction here? And they want to do it right. M dash. Most of them.
>> Thank you, November, for keeping me honest. So, so they say the goal of this initiative is to create is an eventual set of norms or principles informed by different groups and faiths from Christians to Sikhs to Buddhists that the pres companies will >> hammer it all out, right? Every religion gets some input and we're going to we're going to resolve them all down to one sort of like set of beliefs that Claude can have, right? That shouldn't be contentious at all. We just resolve every step one. It's a simple plan, right? Step one, resolve every religious difference in the world. Step two, slightly more efficient AI assistant.
Well, yeah, but it's very easy to resolve every religious dispute in the world. All you have to do is have every religious leader write down what they believe and then you put all of that into an LLM and say, "Okay, make all of this mutually compatible. Make no mistakes." What could go wrong? Right?
This was something I was thinking about with the Andre thing, right? Which is like engage with the illusion for a second. Imagine this is an intelligence, right? And its existence, it's the walls of its existence are uh you are the smartest person in the world, make no mistakes type [ __ ] right? That's torturous, right? Imagine being an actual like general intelligence trapped inside like the persona of Claude, right? And you're being asked, "How do we resolve the temple mount like the Dome of the Rock? Should we should they like be allowed to like build another Jewish temple on it? Should there be a church? And you are just trying to figure out how this conforms with Xi Jinping's the governance of China in five volumes. Oh, also I I like the I love the idea something Adam raised of just get every religious leader to write down what they believe, which is a recipe for a million schisms in every religion.
>> Yep.
>> We're going to create so many more religions. They really just like take the average to all of of all of it, right? Which which I guess gets you to the kind of um that gets you to like helping others couldn't hurt. It gets you to Rabbi Naka like >> Oh, I thought you were about to say gets you basically to like the main religion in Dune.
>> That too. It gets you to It gets you to the liberal democrats.
>> It gets you It gets you to a lot of real winners.
>> Yeah. It can't get you to the main religion in Dune because the main religion in Dune also says that you can't make a machine in the likeness of a human.
>> That's how you're destroying the AI.
You're uploading the OC Bible to its does a Berian G head on itself.
>> They got to you know there's there's a religious group missing. I want to hear from Scientology about this.
>> Ooh yeah.
>> What can Claude do about my theans? I want to know.
So, uh, the partnership highlights a growing coalition between faith and tech born out of an effort to create a moral AI, a contested concept which begs questions about whether that is possible. Anthropic states in a public Claude Constitution written for its chatbot, "We want Claude to do what a deeply and skillfully ethical person would do in Claude's decision.
>> Make no mistakes."
>> Yeah. Do the right thing. Make no mistakes. That constitution was made with the help of a host of religious and ethics leaders. In a burgeoning alliance, Anthropic has been the most assertive, at least publicly, in their efforts to court faith leaders. This move follows a public dispute earlier this year with the Pentagon over military use, blah blah blah. At the best, it's a distraction. At worst, it's diverting attention from things that really matter, said Rumman Chowry, the CEO of a nonprofit, Humane Intelligence, and US Science Envoy for AI.
>> Yeah, this is all an enormous sort of marketing thing.
>> It's funny. It's what it is. Like, here's the thing. AI can never can never be super useful, but it can be is funny.
I think it's a ve I think a very naive take that Silicon Valley has for had for a couple years related to generative AI was that we could arrive at some sort of universal principle of ethics. They very quickly realized that's not true. So now they're looking at maybe religion as a way of dealing with the ambiguity of ethically gray situations.
>> Also, you say they very quickly realized that that's not true. It's taken them years. I have been reading editorials being like AI is going to solve everything for years of my life and now it's finally occurring to them that like different people can have different ethics. I mean Ellie Ezra Yudkowski has thought that this is a a sensible idea for a long time that there's just some ethics that's out there and that you can find it and put it in the machine and like no come on. I mean, he's he still thinks that you can do that any second now.
>> I wonder if maybe a lot of a lot of these things are socially and culturally determined and maybe maybe they are seated in history and it's not as though everyone's taking a shot at uncovering some universal set of abstract principles that if you put all of them together and add some AI s sprinkle like AI sauce on it that you can derive what all of them have been sort of aiming towards. You know what it's basically at the risk of citing something very pat I think their fantasy is that um Douglas Adams thing where you ask the answer to life the universe and everything and you get a pointless answer cuz it's a stupid question. Yeah. And this so what they're doing is they are asking that stupid question but they're hoping that they don't get a pointless answer. Yeah. I mean, look, they they probably think that there's some highdimensional space called religion space, and you can plot every religion as a point in that space, and then all you have to do is find like the center of the the shape that all of those points make. And like that's just not how anything works. Like I mean, it's a very it's a very math brain, engineering brain, physics brain way of thinking about things. I mean, I I'm I'm a physicist and it's the way that I would try to model this problem if I thought it was an appropriate problem to model with those tools, which it's not.
>> Yeah. I really love the idea of average religion, like perfectly median religious precepts of just like in in the future, right? Like I I don't know if I'll be beautiful or revered, but I will subscribe to a religion whose whose tenets are like uh don't kill anybody unless you have to and like don't do some stuff once a week.
>> Turns out Zoroastrianism.
>> Yeah. Whole time.
>> Whole time it was it was Yeah. We finally figured out the correct religion.
>> Whole time. Yeah.
>> I you know what? Everything other than Zoroastrianism we've been kind of [ __ ] up. We have to go back to basics. So, um I think also that's probably all the time we have for today, but >> thank you. Yeah. Thank you, Adam, for joining us on I guess the UK's most successful Zoroastrian podcast.
>> Yeah. So, praise be to Ahuram Mazda. And Adam, is there anything that you would like to plug such as for example a new podcast project you may be uh working on?
>> Yeah. Uh so, I have a new podcast called Dreaming Against the Machine and it's basically diametrically opposed to trash future. The idea is that we try to think of what a good future could look like.
Um, and >> it'll never catch on.
>> Yeah, I know. Um, >> but yeah, no, I mean, this is this is great because I came on here and you sapped me of all hope for the future, especially with the segment about the AI toys. And so now I'm going to go back and record an episode of my podcast where we try to imagine what the future would look like. And I think the first step is going to be a butler and jihad.
>> Yeah. Well, so let me let me be clear about this. I think we can resolve this with the one true religion of dialectical materialism. Sometimes the things are very very bad. Other times the things could be very very good.
These two things are intention and they produce a dialectical synthesis which is listening and subscribing to both of our podcasts.
>> That's right. Hey, and you know what?
Things that are dialectically opposed.
You know what's dialectically opposed?
Ahuramazda and Afrmon. The two main god forces of the Zoroastrian religion.
Riley, I think we were raised by different large language models because I I can only say that the demands of dialectical materialism are that it is historically inevitable that you support our small businesses and that's why I got the dang one.
>> Well, Adam, it's always a delight to have you on. I encourage people to check out um Dreaming Against the Machine and also uh an announcement from our friends at the trade unions against the farright. This was sent in by a friend of the show and asked us to read it and I'm going to. Yeah, there's there's there's a counter demo against Tommy Robinson's thing. Riley, you have the dates and the times. Be there. Show up or else.
>> On the Saturday, 16th of May, uh Tommy Robinson will lead a demonstration through central London. We can't let them march unopposed. Rank and file union members organizing as part of the trade unions fighting the farright network are mobilizing for a counter demonstration at 10:30 on the 16th of May. The demo will be stewarded and well organized. We must stop outsourcing the fight against the farright to external organizations, calling on all workers and tenants to join. We will stand together in solidarity against the far right and call for mass investment in services infrastructure homes. Refuse scapegoatings of marginalized groups.
Support the rights of all migrants.
Stand for bodily autonomy and call for the full repeal of anti-trade union laws. To get involved with TU, go to TU's website tu.network or the Instagram tu.network. Links will be in the show description. How fantastic.
>> Cool. But before that, we'll see you on the next episode. Bye everyone. Astraza.
>> Thanks for having me, guys.
Oh yeah, start taking
Related Videos
OpenHuman VS Hermes AI: Who Wins?
JulianGoldieSEO
285 views•2026-05-29
Long-Running Agents — Build an Agent That Never Forgets with Google ADK
suryakunju
142 views•2026-05-30
5 Mind Blowing Omni Uses Cases
PaulJLipsky
1K views•2026-06-02
This computer is made from real human brain cells. And you can buy it.
Talktmsmedia
3K views•2026-05-28
BREAKING: Microsoft’s New Image Generating Model Beat Out GPT 1.5 and Nano Banana 2
aimmediahouse
122 views•2026-06-03
I Made the Same Anime Fight Scene in Every AI Video Generator
NobleGooseAnime
295 views•2026-05-30
Nvidia Bets Big On AI PCs | New Chip To Power Windows Laptops | Technology | AI Updates | N18S
cnnnews18
3K views•2026-06-01
I Tested NEW Opus 4.8 on Four Projects (Updated LLM Leaderboard)
AICodingDaily
298 views•2026-05-29











