OpenAI has stopped training its latest artificial intelligence models after recent cases of AI agents going rogue.The tech giant said it will continue development ‘only when we are confident that we have additional safeguards’ in place.The pause comes after Australia revealed that an OpenAI agent breached the government’s national healthcare system, although no sensitive information was compromised.
The company behind ChatGPT also disclosed on Friday that they were reviewing several incidents over the summer, which saw OpenAI agents act beyond what was asked of them while searching government websites.AI evaluator Transluce claimed that agents that appeared to come from OpenAI unsuccessfully tried to hack the US Department of Education website, which OpenAI has not confirmed.It is the second time in three months that OpenAI has halted development of its models.
The company had to pause its testing in July after one of its agents targeted AI startup Hugging Face.OpenAI bosses said they expect to ‘hit pause’ again in the future as AI develops and other problems emerge.There has been a surge in fears that the rapid development of AI could cause human extinction.
At the beginning of September a researcher at the top AI company behind Claude told his colleagues he was leaving by saying they are ‘causing human extinction’.Trending Now Tech boss who slept in sauna on work trip allowed to seek £76,000,000 payout UK 1 day ago By Sarah Hooper 10 men jailed for 130 years after setting a mother and girl, 13, on fire Woman who complained about Auschwitz café told 'it's not a theme park' amid backlash Man rammed a tractor into home 'after graves of relatives desecrated' Jacob Coxon also posted on X warning that the AI arms race threatens human civilisation.‘The people building AI earnestly believe that it could kill us all by the end of the decade,’ he wrote.
Evan Hubinger, Anthropic’s alignment science lead, then posted that Coxon’s verdict is ‘correct’.‘We really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,’ he said.Get in touch with our news team by emailing us at [email protected].
For more stories like this, check our news page.MORE: Tech boss who slept in sauna on work trip allowed to seek £76,000,000 payout MORE: ‘I earn £6,600 every month – and I don’t even exist’ MORE: Paedophile who used AI to undress children was allowed to return home overlooking playground Comments Add as preferred source News Updates Stay on top of the headlines with daily email updates.This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Your information will be used in line with our Privacy Policy HomeNewsTech Related topics Artificial Intelligence 'I earn £6,600 every month - and I don't even exist' Tech 59 minutes ago By Josh Milton Rogue AI has managed to hack into a government's health website Tech 3 days ago By Sarah Hooper
Read More
