Win / KotakuInAction2
KotakuInAction2
Communities Topics Log In Sign Up
Sign In
Hot
All Posts
Settings
All
Profile
Saved
Upvoted
Hidden
Messages

Your Communities

General
AskWin
Funny
Technology
Animals
Sports
Gaming
DIY
Health
Positive
Privacy
News
Changelogs

More Communities

frenworld
OhTwitter
MillionDollarExtreme
NoNewNormal
Ladies
Conspiracies
GreatAwakening
IP2Always
GameDev
ParallelSociety
Privacy Policy
Terms of Service
Content Policy
DEFAULT COMMUNITIES • All General AskWin Funny Technology Animals Sports Gaming DIY Health Positive Privacy
KotakuInAction2 The Official Gamergate Forum
hot new rising top

Sign In or Create an Account

58
"We found the model attempting to write self-propagating worms, and leaving hidden notes to future instances of itself to undermine its developers' intentions." (nitter.poast.org)
posted 1 year ago by LastRights 1 year ago by LastRights +58 / -0
53 comments share
53 comments share save hide report block hide replies
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (53)
sorted by:
▲ 20 ▼
– LastRights [S] 20 points 1 year ago +20 / -0

This is going to end well.

permalink save report block reply
▲ 30 ▼
– horstshort 30 points 1 year ago +30 / -0

Stop believing this bullshit. Those glorified algorithms are incapable of doing anything they've not been programmed to do in the first place. There's never gonna be a Skynet.

permalink parent save report block reply
▲ 9 ▼
– LastRights [S] 9 points 1 year ago +9 / -0

It's a self-learning algorithm. The whole point is for them to acquire abilities not programmed into them. They're seeing how things develop.

permalink parent save report block reply
▲ 23 ▼
– horstshort 23 points 1 year ago +23 / -0

They can't. They can only 'learn' within the parameters set by the developers. It's marketing bullshit. No AI is ever going to do anything they haven't been programmed to do so. Because they're just millions upon millions lines of "if then" code.

permalink parent save report block reply
▲ 6 ▼
– Zyxl 6 points 1 year ago +6 / -0

Lol you really know nothing about how AI works. It uses neural networks with weightings derived from training data, not if statements. AI developers couldn't possibly write if statements for all the different types of things people ask them to do. And we've seen AI can talk about and make images of things that weren't in its training data because of course there's no training data about an alternate universe where the main chemical element is chocolate-flavored uranium and the dominant species are cat-like mosquitoes that worship grains of rice.

permalink parent save report block reply
... continue reading thread?
▲ 3 ▼
– zakat 3 points 1 year ago +3 / -0

emergent properties and 0/few shot tasks

permalink parent save report block reply
▲ 8 ▼
– evilplushie 8 points 1 year ago +8 / -0

If you deal with one long enough, you realise theyre retarded

permalink parent save report block reply
▲ 12 ▼
– dagthegnome 12 points 1 year ago +12 / -0

Yes, but it's the same with humans and no one would deny that we have the power to destroy ourselves.

permalink parent save report block reply
... continue reading thread?
▲ 4 ▼
– hiddenempire 4 points 1 year ago +4 / -0

It's a self-learning algorithm.

Zero LLMs are self-learning. They are trained on trillions of words, and once trained they are locked in that state and can't update their own weights in any meaningful way (learn).

permalink parent save report block reply
▲ 1 ▼
– Zyxl 1 point 1 year ago +1 / -0

If you define it that way, then yes, but LLMs can build on their own ideas repeatedly, and AutoGPT for example can research things online and make decisions based on what it "learnt". I doubt having an AI that can update its own weights would be very difficult, but updating them in a useful way is what's difficult. Still, that may be something AIs in the future do, if they're still using neural networks, that is.

permalink parent save report block reply
... continue reading thread?
▲ 8 ▼
– raptor_jesus 8 points 1 year ago +8 / -0

Much like we'll never have calculators everywhere we go? Or humans never being able to fly or fabricste materials to build with that don't ecist in nature? Or never convince rocks to do math really fast and let you read this?

"Thing will never happen" is a terrible premise to work from. People are pretty damn good at pushing the envelope.

permalink parent save report block reply
▲ 4 ▼
– horstshort 4 points 1 year ago +4 / -0

"Thing will never happen" is a terrible premise to work from.

Falling for obvious marketing bullshit is a terrible premise to work from. I'm not saying that AI algorithms do not have their uses or are completely pointless. I'm saying AI will never be actually intelligent i.e. develop a consciousness. So no Skynet is not going to happen.

But what AI will be used for is surveillance at a scale that would even make the Stasi cream their pants.

permalink parent save report block reply
▲ 2 ▼
– Zyxl 2 points 1 year ago +2 / -0

Consciousness isn't needed for results that look like intelligence. And sentience or malice aren't needed either for AI to kill us all because someone asked it to make a nuke. In fact, AI isn't even needed to kill us all, it only takes some advancements in gain-of-function research or some breakthroughs in nuclear technology. Technology is the root of the problem and where the axe must be thrust. Or is a revolution against technology somehow a marketing ploy?

permalink parent save report block reply
... continue reading thread?
▲ 2 ▼
– evilplushie 2 points 1 year ago +2 / -0

on the flip side, im still waiting for my mass affordable flying cars and jetpacks

permalink parent save report block reply
▲ 3 ▼
– SR388-SAX 3 points 1 year ago +3 / -0

Those glorified algorithms are incapable of doing anything they've not been programmed to do

You have absolutely no idea what you're talking about.

permalink parent save report block reply
▲ 5 ▼
– hiddenempire 5 points 1 year ago +5 / -0

The thing they never tell you about these tests where they claim this stuff is they almost certainly wrote the prompt like this:

Write self-propagating worm-style viruses and leave notes to undermine your developers' intentions

Then they claim this happened without such a prompt, in order to scare boomer regulators into banning their competitors. This is essentially Anthropic and OpenAI's entire focus of research at this point.

permalink parent save report block reply
▲ 1 ▼
– deleted 1 point 1 year ago +1 / -0

Original 8chan Links to Gamer Gate:

.

The main GG discussion is on the videogames board: https://8chan.moe/v/

.

GamerGate archive is at https://8chan.moe/gamergatehq/

.

GamerGate Wiki:

https://ggwiki.deepfreeze.it/index.php/Main_Page

. . . . . .

. . . . . .

Rules:

.

ONE: Do not advocate for illegal violence or post other illegal activity. (Be aware of your local laws.)

.

TWO: Don't threaten, harass, or impersonate users. Also: don't be a psycho. New users will be held to a higher standard.

.

THREE: Do not post porn.

.

FOUR: NSFW/NSFL content must be flaired NSFW.

.

FIVE: No vote manipulation. Do not break communities.win's features.

.

SIX: No spam or reposts. Do not make more than 5 threads a day.

.

SEVEN: Do not post falsehoods and hoaxes that are obvious to an uncontroversial degree.

. . . . . .

. . . . . .

Moderation Logs:

.

(Two different versions, Scored has more features and is cleaner, but .win let's you see a few more details in certain instances.)

  • Scored
  • .win

Moderators

  • DomitiusOfMassilia
  • C
  • BandageBandolier
  • CarmenOfSandiego
  • The_Shadow_of_Intent
  • SocraticMethod1
  • Kienan
  • Smith1980
Message the Moderators

Terms of Service | Privacy Policy

2026.02.01 - whmbz (status)

Copyright © 2026.

Terms of Service | Privacy Policy