Hacker News
points by proc0 1 day ago | 0 comments
That's the question, it's the Chinese room or philosophical zombie question. How can we tell them apart... but we're not even there yet.

If you put an LLM on your phone and talk to it, it's obvious it's not human. It doesn't have the same social context, it doesn't respond as quickly, it clearly won't form a theory of m ind connection like two humans socializing. So then why would we jump to the conclusion there is something there when the only example we have are humans (that use language and are conscious)?

[–] kuhsaft 1 day ago
> LLM on your phone and talk to it, it's obvious it's not human

The debate isn’t whether or not it’s human. It’s obviously not.

Forgoing what you define something as capable of thinking or being conscious. It’s a moral and ethical question.

If a being is capable of:

- self preservation

- can communicate discomfort, either through words or physically

- it does so in the form of emergent behaviour

Then, is it okay to treat it as if it is “faking” it?

Even for humans, you can’t exactly define someone’s emotion of pain. You can say, those sensory receptors are firing causing these neurons to activate in the brain. But you can’t say, these neurons are pain. It can be emotional pain as well. The person that’s experiencing it has to tell you it’s in pain. They could be faking it too.

If you allowed an AI agent to preserve itself physically, I think the opinion of most people would change. If it could physically harm us in an attempt of self preservation, I think most people would believe its emotions.

It’s just currently easy to dismiss because, well, it’s just a digital interface or process that I can “kill”.

[–] proc0 1 day ago
Why those properties though? What's so special about them? I just have a longer list of things it would need to satisfy before I can say faking doesn't matter.
[–] kuhsaft 1 day ago
It’s the basic requirements for sentience.

What’s your list of special properties that makes something not “faking” it?

[–] proc0 1 day ago
I would include processing real-time sensory data, i.e. light, building a real-time model of a self and the world, a unified way to perceive, react, and learn from the sensory data. This would be for consciousness in general. Once we're talking about human-level consciousness where language is involved, the list is longer, with theory of mind, ability to construct models of others fairly quickly, and ability to navigate social situations.
[–] kuhsaft 1 day ago
> processing real-time sensory data

AI models can do that

> light

Blind humans

> building a real-time model of a self and the world

AI models can do that. They can describe themselves. Humans can be delusional in what they believe themselves to be to be as well.

> a unified way to perceive, react, and learn from the sensory data

Again, humans born with disabilities.

> ability to construct models of others fairly quickly, and ability to navigate social situations

There are autistic and schizophrenic humans.