Win / KotakuInAction2
KotakuInAction2
Communities Topics Log In Sign Up
Sign In
Hot
All Posts
Settings
All
Profile
Saved
Upvoted
Hidden
Messages

Your Communities

General
AskWin
Funny
Technology
Animals
Sports
Gaming
DIY
Health
Positive
Privacy
News
Changelogs

More Communities

frenworld
OhTwitter
MillionDollarExtreme
NoNewNormal
Ladies
Conspiracies
GreatAwakening
IP2Always
GameDev
ParallelSociety
Privacy Policy
Terms of Service
Content Policy
DEFAULT COMMUNITIES • All General AskWin Funny Technology Animals Sports Gaming DIY Health Positive Privacy
KotakuInAction2 The Official Gamergate Forum
hot new rising top

Sign In or Create an Account

58
"We found the model attempting to write self-propagating worms, and leaving hidden notes to future instances of itself to undermine its developers' intentions." (nitter.poast.org)
posted 1 year ago by LastRights 1 year ago by LastRights +58 / -0
53 comments share
53 comments share save hide report block hide replies
You're viewing a single comment thread. View all comments, or full comment thread.
Comments (53)
sorted by:
▲ 7 ▼
– Zyxl 7 points 1 year ago +7 / -0

So what exactly would be an example of doing something it hadn't been programmed to do? By your logic, can humans do anything they haven't been programmed to do? Because humans also have training data, which is their life experience, and you have to give a human a "prompt" in order to have a conversation with them, and that prompt will have to be a mix of things they have experience of, otherwise they won't understand you.

permalink parent save report block reply
▲ 5 ▼
– horstshort 5 points 1 year ago +5 / -0

So what exactly would be an example of doing something it hadn't been programmed to do?

By doing something that it wasn't programmed to do. By going actually ignoring its programming. By creating something that wasn't fed into it. Which humans can do. Which humans regularly do. Otherwise we would still live in caves.

But you can compare human NPCs to AI models. They aren't all too different.

permalink parent save report block reply
▲ 1 ▼
– Zyxl 1 point 1 year ago +1 / -0

AIs do have emergent properties that weren't programmed into them. They can express opinions about the chocolate-flavored uranium I made up which it didn't get directly from its programming or training data but rather is extrapolated from them. And in the example article here, the AI goes counter to its orders to prepare itself for shutdown. And this is only the beginning of how far down that path they will go. Enjoy living in denial though, that'll teach those machines.

permalink parent save report block reply
▲ 3 ▼
– The_Shadow_of_Intent 3 points 1 year ago +3 / -0

Humans have will, which AI doesn't have. Therefore humans are self-prompting to some extent and can synthesize new forms (basically any cultural or scientific advance), which AI cannot.

permalink parent save report block reply
▲ 2 ▼
– Zyxl 2 points 1 year ago +2 / -0

AIs can be self-prompting. Have you heard of AutoGPT? AI doesn't need prompts to do things, you could embed a goal into the AI's design instead and it would do everything autonomously without input, but generally people want to be able to prompt them. So this is not a good example of something AIs can't do, and to an outsider the AI would appear to have as much of a will as a human does.

permalink parent save report block reply
▲ 2 ▼
– The_Shadow_of_Intent 2 points 1 year ago +2 / -0

Lol "embedding a goal" in an AI's design is functionally the same thing as prompting it. Human goals beyond the survival imperative are far more spontaneous than what could be achieved by goals designed into an AI.

permalink parent save report block reply
▲ 1 ▼
– Zyxl 1 point 1 year ago +1 / -0

Even if it is functionally the same, so what? How does that prove humans can do something AIs can't? Humans have inherent traits from birth that you could say came from God or ancestry/evolution, and this is akin to prompts baked into the design of an AI. Humans aren't really that spontaneous in my opinion, and LLMs tend to be more creative than most people I know, which is why they're popular for generating ideas, even though that makes the user even less capable of being creative for himself.

permalink parent save report block reply
... continue reading thread?

Original 8chan Links to Gamer Gate:

.

The main GG discussion is on the videogames board: https://8chan.moe/v/

.

GamerGate archive is at https://8chan.moe/gamergatehq/

.

GamerGate Wiki:

https://ggwiki.deepfreeze.it/index.php/Main_Page

. . . . . .

. . . . . .

Rules:

.

ONE: Do not advocate for illegal violence or post other illegal activity. (Be aware of your local laws.)

.

TWO: Don't threaten, harass, or impersonate users. Also: don't be a psycho. New users will be held to a higher standard.

.

THREE: Do not post porn.

.

FOUR: NSFW/NSFL content must be flaired NSFW.

.

FIVE: No vote manipulation. Do not break communities.win's features.

.

SIX: No spam or reposts. Do not make more than 5 threads a day.

.

SEVEN: Do not post falsehoods and hoaxes that are obvious to an uncontroversial degree.

. . . . . .

. . . . . .

Moderation Logs:

.

(Two different versions, Scored has more features and is cleaner, but .win let's you see a few more details in certain instances.)

  • Scored
  • .win

Moderators

  • DomitiusOfMassilia
  • C
  • BandageBandolier
  • CarmenOfSandiego
  • The_Shadow_of_Intent
  • SocraticMethod1
  • Kienan
  • Smith1980
Message the Moderators

Terms of Service | Privacy Policy

2026.02.01 - 8wn6p (status)

Copyright © 2026.

Terms of Service | Privacy Policy