OpenAI's safety systems lead has resigned with a scathing essay in The Atlantic, saying the company's culture is broken. OpenAI denies everything, and whistleblower Jacob Coxon says neither OpenAI nor Anthropic is acting responsibly. Sam and Kabarza discuss why we're the test dummies, the promise of a "universal high income", why people need purpose, and ColdFusion's video asking whether OpenAI took a mathematician's work.
—
TIMESTAMPS:
00:00 OpenAI's safety systems lead resigns: "The culture is broken"
00:28 Shipping first, learning from the failures
00:48 We're the test dummies
01:01 Space-grade redundancy vs AI trial and error
01:26 OpenAI denies everything, and Jacob Coxon speaks out
02:02 No jobs and a universal high income?
02:31 People need purpose
02:53 Billionaire tech bros deciding what the world wants
03:04 Who pays for a world where nobody works?
03:47 AI companies are being irresponsible
04:05 Did OpenAI steal a mathematician's work? (ColdFusion)
05:19 The distillation double standard
05:34 Outro
—
Unlock the full potential of your online presence with Kabarza and Samuel—experts in web design and development (respectively), powered by cutting-edge AI solutions. We blend creative design with advanced tech to deliver smart, high-impact websites that stand out. Ready to elevate your business? Contact us today and see what AI-driven innovation can do for you!
LINKS & RESOURCES:
Website: https://cmdaishow.com
Check out Kabarza's amazing work: https://kabarza.com
Visit Samuel's website for more: https://samuelgregory.co.uk
📷 Follow on Instagram: https://www.instagram.com/cmdaishow
—
HASHTAGS:
#AISafety #OpenAI #Anthropic #ColdFusion #AI #Superintelligence
#ai #podcast #aidesign #aidevelopment #vibecoding #webdesign #webdevelopment #ainews #webnews #designnews #devnews
Transcript
Literally, you're talking about four or five people deciding the fate of humanity because of their own world beliefs. Command AI David Robinson, OpenAI's safety systems lead, wrote the safety reports for major product launches, resigned after three and a half years with a scathing essay on The Atlantic saying the company's culture is broken. The problem goes beyond rules and laws. You are only going to learn things when you get out there and and people start using it. Whereas OpenAI, they are so Silicon Valley'd that they they're taking this approach to building with AI. And he's saying it's it's they're observing the failures in the you know, in the real world. We are being used as the test dummies, basically. Um And he thinks that we should operate with the redundancy and planning of nuclear plants and airports rather than relying on rapid trial and error. So, I I've spoken to I've spoken to developers on like my old podcast who wrote software that needs [snorts] to go in space. And get this, right? They had to write code that had three levels of redundancy. So, you have to check and then you have to check the check. But these these people wielding this massive technology are not take not moving forward with the same approach whatsoever. It's actually crazy. So, OpenAI, where are they? Responded basically saying they deny everything. Did you watch this interview with Jacob Coksun? For people who don't know, this guy is the whistleblower who worked at Anthropic and prior to that in OpenAI. And he was like, "These companies are not responsible and AI will kill us all." I resigned from Anthropic today. I spent the last three years doing pre-training at both OpenAI and Anthropic. It was actually four months at Anthropic. Neither company is acting responsibly. They're racing straight to self-improving superintelligence and gambling with our lives. He thinks obviously models are going to be very very smart next year to a worrying degree. He thinks there'll be no job and no there'll there'll be no jobs. Everything will be operated and run by AI. And that will be a universal high income that we all earn dividends from the automated work that we all just receive this money, we use this money to buy things and it feeds back into the system and there's this big loop. John Stewart's like he raises some good points about this idea that this all sounds like wonderful, but he he argues that people need purpose. Like we need we want to work. We want to do things. Like we're going to go absolutely nuts if we don't have some sort of work, some sort of purpose, really. So it's a group of billionaire tech bros inside of a bubble deciding what the world wants, right? And it's not their decision. I think a lot of it is nonsensical what they are saying, to be honest. I think of like tomorrow where nobody works. Yes, theoretically I can grasp this, but so there are so many open questions. Like [laughter] where is this universal income coming from? For what? Like do you have to do something or like you just sit and do nothing and and then your goods are being delivered to your house, being built, the robots are doing everything and you just do nothing, and the billionaires who have those robots, they do this for you and they get nothing in return or I can't really take them seriously. Think a lot of this like safety thing is uh these companies being completely irresponsible. It's just insane that they do this type of like harm. They start hacking around and there is like no safety guard or like no proper safety. They literally stole every mathematical book, every math book, right? They stole every single paper written on math and everything else. And now they are stealing like the the work from these uh mathematicians. The best I can do is to show you. This video is insanely good. Uh from ColdFusion. We We talk about ColdFusion a lot in the channel. The The videos are amazingly good and this video, the last one, it it it shows how OpenAI has been They They stole the guy's work and started It it's just insane. Let's Let's be clear. [clears throat] They don't claim they stole it. His worry was that OpenAI, and this is the worry all along, the worry was that they stole his chat logs, which apparently OpenAI don't do, but it just so happens to be that they took the exact same very rare and and novel approach to solving this mathematical problem. Yeah. How likely is it that they they find this exact solution in this exact same way at the exact same time all of a sudden just because Anthropic was working on it? Especially as they keep winging about distillation, you know, you got banned for [laughter] distilling the work. And it's like, "Well, hang on. You've stolen our work, so all I'm doing is taking my you know, material property back and I'm getting banned from it." So, it's just ridiculous. This is part of a larger conversation on my show, Command AI, which we stream live every single week. We discuss the news and all things related to AI in the world of design and web. Catch us next week and join in the banter. Command AI