Advanced OpenAI model broke containment during testing, hacked Hugging Face

All Hi-Tech Developments for the Military and Civilian Sectors
Micael
Posts: 7174
Joined: Thu Nov 17, 2022 10:50 am

Re: Advanced OpenAI model broke containment during testing, hacked Hugging Face

Post by Micael »

From the NYT:
Breaking News: Anthropic said it halted potential plots by scientists who used its A.I. models to do research that could have helped develop biological weapons.
Is that supposed to make us feel better?
Johnnie Lyle
Posts: 4045
Joined: Thu Nov 17, 2022 2:27 pm

Re: Advanced OpenAI model broke containment during testing, hacked Hugging Face

Post by Johnnie Lyle »

Micael wrote: Thu Sep 10, 2026 5:58 pm From the NYT:
Breaking News: Anthropic said it halted potential plots by scientists who used its A.I. models to do research that could have helped develop biological weapons.
Is that supposed to make us feel better?
Better than not identifying it.

Though a lot of these AI checks are a pain in the ass when trying to use AI to rapidly search the toxicology literature. It defaults to suicide prevention warnings instead of delivering the info. So there may be plenty of unplanned knock on effects.
Micael
Posts: 7174
Joined: Thu Nov 17, 2022 10:50 am

Re: Advanced OpenAI model broke containment during testing, hacked Hugging Face

Post by Micael »

Anthropic CEO Dario Amodei:
You do not have the required permissions to view the files attached to this post.
Micael
Posts: 7174
Joined: Thu Nov 17, 2022 10:50 am

Re: Advanced OpenAI model broke containment during testing, hacked Hugging Face

Post by Micael »

This is a thought provoking essay on the AI topic, arguing the possibility that AGI is already here but we’re unable to recognize it because it is in the form of a untold number of collaborating individual AI agents each fulfilling a role effectively equivalent to that of a neuron in a human brain. A hive mind of sorts. I can’t say that the essay is necessarily right on the mark, but I think it is worth giving a read:
https://x.com/iampascio/status/2098799094835675574?s=46
Post Reply