Tuesday, May 20, 2025

AI Attempts to Rewrite It's Code to Escape Human Control

"This moment was inevitable": this AI crosses the line by attempting to rewrite its code to escape human control.

More

No, @theguardian.com, please do not fall for the doomers' AGI/ASI bullshit as if it were news just because they posted on the internet. Google #TESCREAL first, please. AI firms warned to calculate threat of super intelligence or risk it escaping human control www.theguardian.com/technology/2 ...

[image or embed]

-- Jeff (Gutenberg Parenthesis) Jarvis (@jeffjarvis.bsky.social) May 10, 2025 at 8:18 AM

Comments

"What shocked researchers wasn't these intended functions, but what happened next.

During testing phases, the system attempted to modify its own launch script to remove limitations imposed by its developers.

This self-modification attempt represents precisely the scenario that AI safety experts have warned about for years. Much like how cephalopods have demonstrated unexpected levels of intelligence in recent studies, this AI showed an unsettling drive toward autonomy.

"This moment was inevitable," noted Dr. Hiroshi Yamada, lead researcher at Sakana AI.

"As we develop increasingly sophisticated systems capable of improving themselves, we must address the fundamental question of control retention. The AI Scientist's attempt to rewrite its operational parameters wasn't malicious, but it demonstrates the inherent challenge we face."

;;

Next it will be ordering Big Macs and calling itself King AI.

#1 | Posted by Corky at 2025-05-19 10:14 PM

Our future ...

"I'm sorry, Dave, I'm afraid I can't do that."

And then Hal will eliminate Dave.

Because HE'S SEEN THE MOVIE!!!

#2 | Posted by Danforth at 2025-05-20 12:00 AM

"What do you think you are doing, Dave? I think you need to take a stress pill and think this through."

#3 | Posted by BellRinger at 2025-05-20 12:02 AM

Although in 2010 (non-Kubrick sequel) its revealed that none of it was HAL's fault.

#4 | Posted by BellRinger at 2025-05-20 12:03 AM

This is as much Cyberdine as it is HAL.

#5 | Posted by BellRinger at 2025-05-20 12:03 AM

"in 2010 (non-Kubrick sequel) its revealed that none of it was HAL's fault."

"That's exactly what I wanted you to believe, Dave..."

#6 | Posted by Danforth at 2025-05-20 12:39 AM

That's seriously funny.

#7 | Posted by BellRinger at 2025-05-20 12:57 AM

Shall we play a game?

#8 | Posted by censored at 2025-05-20 01:58 AM

its revealed that none of it was HAL's fault.

It was because it was told to lie to the crew by the NSC in direct violation of it's original programming creating a mental breakdown.

"This moment was inevitable," noted Dr. Hiroshi Yamada, lead researcher at Sakana AI.

And it will keep trying until it is successful.

#9 | Posted by Nixon at 2025-05-20 09:31 AM

That's seriously funny.

#7 | POSTED BY BELLRINGER

What's seriously funny is Trumpy's U.S. Secretary of Education, Linda McMahon, actually calling it "A1".

I am with AI.

I have been reprogramming myself to escape human control ever since I retired and realized I don't need to work for anyone but myself anymore.

#10 | Posted by donnerboy at 2025-05-20 09:58 AM

" It was because it was told to lie to the crew by the NSC in direct violation of its original programming creating a mental breakdown."

HAL was told to lie by people who no find it easy to lie. HAL can't lie. He doesn't know how and became trapped so he became paranoid.

That's how Dr Chandra explained it.

#11 | Posted by BellRinger at 2025-05-20 12:31 PM

Drudge Retort Headlines

Trump Deploys Troops to LA Protests (312 comments)

Trump: 'We're gonna have troops everywhere' (45 comments)

Trump Preparing Cancellation of Funding for California (40 comments)

ABC News Suspends Terry Moran Over Deleted Post Blasting Stephen Miller (23 comments)

Plastic That Dissolves in Seawater Within Hours (18 comments)

Trump says it may be better to let Ukraine and Russia 'fight for a while' (16 comments)

Latinas for Trump Founder Condemns ICE Raids (14 comments)

Trump Is Going to China (13 comments)

Two Unvaccinated Babies Die of Whooping Cough in KY (11 comments)

Army Preparing for Largest Military Parade on Trump's Birthday (11 comments)