A latest report card from an AI security watchdog isn’t one which tech firms will need to stick on the fridge.
The Way forward for Life Institute’s newest AI security index discovered that main AI labs fell brief on most measures of AI accountability, with few letter grades rising above a C. The org graded eight firms throughout classes like security frameworks, threat evaluation, and present harms.
Maybe most evident was the “existential safety” line, the place firms scored Ds and Fs throughout the board. Whereas many of those firms are explicitly chasing superintelligence, they lack a plan for safely managing it, in keeping with Max Tegmark, MIT professor and president of the Way forward for Life Institute.
“Reviewers found this kind of jarring,” Tegmark instructed us.
The reviewers in query have been a panel of AI teachers and governance consultants who examined publicly out there materials in addition to survey responses submitted by 5 of the eight firms.
Anthropic, OpenAI, and GoogleDeepMind took the highest three spots with an general grade of C+ or C. Then got here, so as, Elon Musk’s Xai, Z.ai, Meta, DeepSeek, and Alibaba, all of which obtained Ds or a D-.
Tegmark blames an absence of regulation that has meant the cutthroat competitors of the AI race trumps security precautions. California not too long ago handed the primary legislation that requires frontier AI firms to reveal security data round catastrophic dangers, and New York is at the moment inside spitting distance as effectively. Hopes for federal laws are dim, nonetheless.
“Companies have an incentive, even if they have the best intentions, to always rush out new products before the competitor does, as opposed to necessarily putting in a lot of time to make it safe,” Tegmark stated.
In lieu of government-mandated requirements, Tegmark stated the trade has begun to take the group’s usually launched security indexes extra significantly; 4 of the 5 American firms now reply to its survey (Meta is the one holdout.) And firms have made some enhancements over time, Tegmark stated, mentioning Google’s transparency round its whistleblower coverage for instance.
However real-life harms reported round points like teen suicides that chatbots allegedly inspired, inappropriate interactions with minors, and main cyberattacks have additionally raised the stakes of the dialogue, he stated.
“[They] have really made a lot of people realize that this isn’t the future we’re talking about—it’s now,” Tegmark stated.
The Way forward for Life Institute not too long ago enlisted public figures as numerous as Prince Harry and Meghan Markle, former Trump aide Steve Bannon, Apple co-founder Steve Wozniak, and rapper Will.i.am to signal a assertion opposing work that might result in superintelligence.
Tegmark stated he want to see one thing like “an FDA for AI where companies first have to convince experts that their models are safe before they can sell them.
“The AI industry is quite unique in that it’s the only industry in the US making powerful technology that’s less regulated than sandwiches—basically not regulated at all,” Tegmark stated. “If someone says, ‘I want to open a new sandwich shop near Times Square,’ before you can sell the first sandwich, you need a health inspector to check your kitchen and make sure it’s not full of rats…If you instead say, ‘Oh no, I’m not going to sell any sandwiches. I’m just going to release superintelligence.’ OK! No need for any inspectors, no need to get any approvals for anything.”
“So the solution to this is very obvious,” Tegmark added. “You just stop this corporate welfare of giving AI companies exemptions that no other companies get.”
This report was initially revealed by Tech Brew.
