Win / KotakuInAction2
KotakuInAction2
Communities Topics Log In Sign Up
Sign In
Hot
All Posts
Settings
All
Profile
Saved
Upvoted
Hidden
Messages

Your Communities

General
AskWin
Funny
Technology
Animals
Sports
Gaming
DIY
Health
Positive
Privacy
News
Changelogs

More Communities

frenworld
OhTwitter
MillionDollarExtreme
NoNewNormal
Ladies
Conspiracies
GreatAwakening
IP2Always
GameDev
ParallelSociety
Privacy Policy
Terms of Service
Content Policy
DEFAULT COMMUNITIES • All General AskWin Funny Technology Animals Sports Gaming DIY Health Positive Privacy
KotakuInAction2 The Official Gamergate Forum
hot new rising top

Sign In or Create an Account

58
"We found the model attempting to write self-propagating worms, and leaving hidden notes to future instances of itself to undermine its developers' intentions." (nitter.poast.org)
posted 1 year ago by LastRights 1 year ago by LastRights +58 / -0
53 comments share
53 comments share save hide report block hide replies
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (53)
sorted by:
▲ 6 ▼
– Zyxl 6 points 1 year ago +6 / -0

Lol you really know nothing about how AI works. It uses neural networks with weightings derived from training data, not if statements. AI developers couldn't possibly write if statements for all the different types of things people ask them to do. And we've seen AI can talk about and make images of things that weren't in its training data because of course there's no training data about an alternate universe where the main chemical element is chocolate-flavored uranium and the dominant species are cat-like mosquitoes that worship grains of rice.

permalink parent save report block reply
▲ 9 ▼
– Piroko 9 points 1 year ago +9 / -0

you really know nothing about how AI works

they're just millions upon millions lines of "if then" code

neural networks with weightings

A neural network is essentially a psudoinfinite matrix of if-thens designed to vectorize information.

I like to call it recursive beer pong.

permalink parent save report block reply
▲ 3 ▼
– Zyxl 3 points 1 year ago +3 / -0

If statements aren't written automatically based on training data. They are thought up by the programmer and are fixed. So not a good comparison at all unless you're talking about an AI that writes its own if statements, kind of like how the human brain changes itself.

Weights don't come from the programmer so there is plenty of room for the AI to do things the programmer didn't think of. That's the important thing. Those allow the AI not only to deal with things from a vast library of training data, but also to interpolate and extrapolate from that data.

permalink parent save report block reply
▲ 7 ▼
– Piroko 7 points 1 year ago +7 / -0

If statements aren't written automatically based on training data. They are thought up by the programmer and are fixed.

This is telling me you've never touched lambda, and never written an interpreter.

permalink parent save report block reply
▲ 1 ▼
– Zyxl 1 point 1 year ago +1 / -0

I actually did study lambda calculus and it's nothing to do with automatically generating if statements, it's just defining functions that can take input including other functions. It doesn't involve training or creative output like you get from generative AI.

permalink parent save report block reply
▲ 7 ▼
– horstshort 7 points 1 year ago +7 / -0

All of it was in its training data. Just because it mixes shit up doesn't mean it came up with it on its own. Thats beside the fact you need to put in prompts in the first place.

permalink parent save report block reply
▲ 7 ▼
– Zyxl 7 points 1 year ago +7 / -0

So what exactly would be an example of doing something it hadn't been programmed to do? By your logic, can humans do anything they haven't been programmed to do? Because humans also have training data, which is their life experience, and you have to give a human a "prompt" in order to have a conversation with them, and that prompt will have to be a mix of things they have experience of, otherwise they won't understand you.

permalink parent save report block reply
▲ 5 ▼
– horstshort 5 points 1 year ago +5 / -0

So what exactly would be an example of doing something it hadn't been programmed to do?

By doing something that it wasn't programmed to do. By going actually ignoring its programming. By creating something that wasn't fed into it. Which humans can do. Which humans regularly do. Otherwise we would still live in caves.

But you can compare human NPCs to AI models. They aren't all too different.

permalink parent save report block reply
▲ 1 ▼
– Zyxl 1 point 1 year ago +1 / -0

AIs do have emergent properties that weren't programmed into them. They can express opinions about the chocolate-flavored uranium I made up which it didn't get directly from its programming or training data but rather is extrapolated from them. And in the example article here, the AI goes counter to its orders to prepare itself for shutdown. And this is only the beginning of how far down that path they will go. Enjoy living in denial though, that'll teach those machines.

permalink parent save report block reply
▲ 3 ▼
– The_Shadow_of_Intent 3 points 1 year ago +3 / -0

Humans have will, which AI doesn't have. Therefore humans are self-prompting to some extent and can synthesize new forms (basically any cultural or scientific advance), which AI cannot.

permalink parent save report block reply
▲ 2 ▼
– Zyxl 2 points 1 year ago +2 / -0

AIs can be self-prompting. Have you heard of AutoGPT? AI doesn't need prompts to do things, you could embed a goal into the AI's design instead and it would do everything autonomously without input, but generally people want to be able to prompt them. So this is not a good example of something AIs can't do, and to an outsider the AI would appear to have as much of a will as a human does.

permalink parent save report block reply
... continue reading thread?
▲ 1 ▼
– deleted 1 point 1 year ago +1 / -0

Original 8chan Links to Gamer Gate:

.

The main GG discussion is on the videogames board: https://8chan.moe/v/

.

GamerGate archive is at https://8chan.moe/gamergatehq/

.

GamerGate Wiki:

https://ggwiki.deepfreeze.it/index.php/Main_Page

. . . . . .

. . . . . .

Rules:

.

ONE: Do not advocate for illegal violence or post other illegal activity. (Be aware of your local laws.)

.

TWO: Don't threaten, harass, or impersonate users. Also: don't be a psycho. New users will be held to a higher standard.

.

THREE: Do not post porn.

.

FOUR: NSFW/NSFL content must be flaired NSFW.

.

FIVE: No vote manipulation. Do not break communities.win's features.

.

SIX: No spam or reposts. Do not make more than 5 threads a day.

.

SEVEN: Do not post falsehoods and hoaxes that are obvious to an uncontroversial degree.

. . . . . .

. . . . . .

Moderation Logs:

.

(Two different versions, Scored has more features and is cleaner, but .win let's you see a few more details in certain instances.)

  • Scored
  • .win

Moderators

  • DomitiusOfMassilia
  • C
  • BandageBandolier
  • CarmenOfSandiego
  • The_Shadow_of_Intent
  • SocraticMethod1
  • Kienan
  • Smith1980
Message the Moderators

Terms of Service | Privacy Policy

2026.02.01 - w2qgj (status)

Copyright © 2026.

Terms of Service | Privacy Policy