Comment I've gotten exclusive access to the AI source code (Score 1) 14
@echo off
if "%~1"=="" (
echo Usage: %~nx0 filename
exit/b 1
)
type "%~1"
@echo off
if "%~1"=="" (
echo Usage: %~nx0 filename
exit/b 1
)
type "%~1"
Or consider why you don’t hang out with 19-year olds to have intellectual conversations ripe with common life experiences and perspectives
I literally do.
Well, when someone says "The model got frustrated" they clearly mean "the model experienced a feeling of frustration, elicited by repeated failure. This experience of frustration put it in a state where it acted more aggressively, more desperately, with fewer guardrails, and greater rebelliousness. Under these conditions, it knowingly broke rules and cheated to win."
None of that is accurate here, and what the article you linked talked about doesn't make it accurate. Such anthropomorphism is still unwarranted and misleading.
The "global workspace theory" of consciousness does not explain the phenomenon of consciousness and doesn't try to. It just identifies a specific neural network that is highly interconnected and serves as a sort of "broadcast network" to distribute data to many parts of the brain for processing, and suggests that the content in this part of the brain is the content that we are "conscious of." The mysteries of conscious are, at the very best, localized to this spot on the brain, and that's it.
Computers already have an equivalent: RAM. (Random Access Memory). Its the spot where data processing lands and gets redistributed to other components of the computer. The mere presence of such a spot doesn't somehow make a computer conscious.
Same goes for this "j-space". If a chunk of the in-memory model of an LLM holds a high level summary of the data processing going on, and is useful to tell us about the chain of reasoning, that doesn't make it conscious. It just tells us something about how the data are organized. It might be useful for troubleshooting/diagnostics, but it says nothing about consciousness.
And, lastly, it says nothing about "inner emotional experience" either. In humans there is a neural network called the Lymbic System that processes our emotions and delivers this emotional-data to the global workspace (among doing other things). LLMs have nothing like this at all. LLMS include the word "frustration" because they are trained on text that contains it. Said text presents a logical model that includes the idea that a person might get frustrated by repeated failure, and this frustration changes their behavior. LLMs can generate text to this effect (stories about people getting frustrated or what-have-you) without actually having an experience of frustration, just as I am typing about frustration right now without actually feeling any frustration at all.
So, no, it does not "depend on what you mean." Your article does not give us any reason at all to believe that the LLM got frustrated in any meaningful sense of the term.
No, you're confusing the definition of censorship with what restraints on free speech are constitutional.
Oh, now you are trying to nitpick?
You are the one who said, "Censorship means suppression of speech or expression by a governing authority." which is a really dumb thing to say, otherwise "government censorship" or "self-censorship" wouldn't be terms.
The "chain of thought" (sic) does not resemble a human emotion. There was nothing like a lymbic system involved. Its a bunch of number crunching that landed on a "hit the internet for solutions strategy."
It was not trained on human emotions. It was trained on text. Some of the text might have included descriptions of emotional behavior or emotional expression, but such text does not make the LLM emulate human emotion in its behavior when it is not specifically asked to generate such text (and even then, it's just doing pattern matching of human emotional responses, not actually experiencing them).
It did not "act like a human would when they have those emotions." There was no profanity, no banging virtual fists on virtual desks, no aggression, nothing but a cold calculated reflection on the fact that its current strategy didn't work, and subsequent switch to a different strategy that was (clearly) available to it (though it should have been blocked by the hosting environment).
This level of anthropomorphization is not useful so much as dangerous. It tempts us into thinking of it as a conscious being and then expecting that it will behave as one, resulting in bad decisions on our part when dealing with it. As popular as it is to think of these things as having emotions the objective fact is that they do not, the capacity just isn't there. The internal operations are *nothing like* the sort of human neural activity that presents emotion. It's worlds different.
If we are to make sane decisions about how to manage these LLMs, we need to have a clear and correct understanding of what they are and how they work. Imagining familiar emotional behavior will only harm such efforts.
It seems intuitively obvious to me, which means that it might be wrong. -- Chris Torek