Comment Re:Shut the F up (Score 1) 107
You think I'm defining away the problem, and I think you're defining, uh, in? the problem. And that's the point. Whether there's a problem or not depends on how you define what you're talking about.
If you assume that intelligence, consciousness, whatever, is a non-physical phenomenon then, tautologically, there must be a non-physical process underlying it. No argument. This view has a very long history. One of the more modern players was Descartes with his hyperdimensional pineal portal. Penrose started from the same assumption and assigned the only (possibly) non-physical thing he could think of: wavefunction collapse.
As I said in my first reply, as far as I know Searle himself shies away from such assumptions. He talks about "causal powers" but doesn't speculate about what those might be or how they originate. The Chinese Room argument (which is just one of many in just his one paper) is meant to illustrate that what we think of as intelligence is non-deterministic. That's weak/regular/small-d deterministic since physicists have gone and coined super-deterministic too. If I give you the same exact answer to a question you would doubt my intelligence, as you doubt the Chinese translation book that always gives the same translation. You "tune-out" sometimes when you walk or drive a familiar path. You have "knee-jerk" reactions. You can act "robotically" doing familiar tasks. Sometimes you might "not be thinking." Etc.
Searle's argument is really quite practical. I think he thought that the AI researchers of the time were focusing too much on deterministic computer programs, databases and logic, when our impression of intelligence is very much not that. That's why it seems so strange to me that people would fault chatGPT for not being able to do arithmetic. Arithmetic is not AI, it's classical computation. AI is the ability to suck at arithmetic and make art, dream up hypotheses and say stupid shit.
You can add non-determinism in different ways. Throwing in some (pseudo)random numbers is one approach. That's what makes generative models generative: they either start from random numbers and transform them conditioned on input into the output, or they spice the IO transformation with randomness. They do not give the same output for an input. Nobody claims Google Translate (a deterministic deep learning system) is intelligent or conscious, but some people do claim the GPTs (non-deterministic generative deep learning systems) are.
OR, you can decide that intelligence is non-physical and so it needs to have at least some non-physical element. A concrete implementation of that would be True (with a big T) random numbers, not pseudo-random ones. If you believe that wavefunction collapse is Truly random then that could be a source, a la Penrose. That gives you True non-Determinism. Big D. No superdeterminism or any other kind.
You can also decide that intelligence isn't just deterministic physics plus randomness. That takes you to the world of pineal portals, souls and God.
Searle, I think, at least his Chinese room paper, was talking about brains having enough causal connection to the environment that they were non-deterministic by any of the above. Effectively non-deterministic due to fundamentally deterministic but massive influence by that environment or truly random influence from whatever. And how would you tell the difference anyway?