Hacker News
points by viraptor 2 days ago | 0 comments
I'm not sure why you think so. We know that very local brain injuries can result in personality changes, sometimes dramatic ones. And that's in a system evolved to deal with constant damage and rebuilding. With LLMs trained to achieve the opposite of that (minimal redundancy, maximum performance), the effect is similar but more extreme.
[–] proc0 1 day ago
I just don't know if "similar" is good enough. We know what thinking is based on biological brains, so if we are to conclude it happens in machines, the experiment should have identical results, or it's more probable that it's something completely different.

The way around this is to have a predictive theory of how thoughts work, and if that is proven true, then use that to analyze the LLMs. So far we have no such theory so I think the only tool is to look at the exact behavior match.

[–] adjejmxbdjdn 1 day ago
Why would the thinking need to be identical?

It’s likely thinking can work in many different ways. It’s likely consciousness can also arise through many different pathways, even if evolution led to biological animals having similar consciousness/thinking pathways. But that would be the result of a common ancestor and the tremendous evolutionary advantage thinking and consciousness gave the specific species.

It wouldn’t indicate that’s the only way thinking and consciousness can occur.

[–] kuhsaft 1 day ago
> But that would be the result of a common ancestor

Funnily enough, humans would be the ancestors of LLMs

[–] kuhsaft 1 day ago
> We know what thinking is based on biological brains

All we know is that it’s a bunch of neurons activating until the person that is thinking describes what they are thinking of.

The same way a thinking AI model activates a bunch of “neurons” - and with newer thinking models utilize a hidden latent space also not understandable - to think before describing what it’s thinking of.

[–] viraptor 1 day ago
> We know what thinking is based on biological brains

That's a big claim. Do we really?

> so if we are to conclude it happens in machines, the experiment should have identical results

Why? Same idea can have multiple different implementations with very close effective result. Both humans and spiders can walk and both use legs, right? But the details are entirely different.

[–] proc0 1 day ago
I should rephrase on the first one. We only have one source of reference for what thinking is and where it happens.

On the second one, yes there can be multiple ways that consciousness can manifest in wildly different systems, but what theory do we have that would validate these other different kinds of consciousness? Without that theory for validation the safer bet is to stick with what we already have a reference to, unless the claim is that consciousness is such an easy algorithm it can easily be stumbled upon by all kinds of systems, i.e. a bunch of matrix multiplications that doesn't even run in real-time (it executes prompts and then stops). I think that is not likely in my opinion.

[–] kuhsaft 1 day ago
> that doesn't even run in real-time

We have realtime AI models

> it executes prompts and then stops

A wood frog can freeze and be “dead”, then thaw and resume life.

> consciousness is such an easy algorithm it can easily be stumbled upon by all kinds of systems

Maybe it is. There’s no reason to think that sentience and consciousness are rare.

The more you learn about biology, the more apparent it is that a lot of the qualities that we think are unique to humans aren’t.

But it doesn’t make different forms of life any less special. There’s an insane complexity and efficiency to biological systems to appreciate still.

Are humans still special? Yes. Is it because we’re sentient and conscious? No.

Should you be humane to all sentient and conscious beings? Probably?

[–] mellab2 1 day ago
That sounds a bit like saying planes can’t fly because they don’t flap their wings like birds do
[–] fzeindl 2 days ago
> We know that very local brain injuries can result in personality changes, sometimes dramatic ones.

But not damage to a single neurons. You are talking about damage to thousands of neurons.

[–] kuhsaft 1 day ago
These models have 100s of thousands of “neurons” whereas human brains have 10s of billions. The difference in scale of “synapses” is even greater.

To make it equivalent you would need at least 100,000 of these models.

You could easily replicate the apparent redundancy and resiliency of the human brain with a consensus system.

[–] viraptor 1 day ago
Literally addressed by the last sentence. There's no reason for redundancy in LLMs, so any local impact will be larger than in brains.
[–] busssard 1 day ago
If you think about this in percentages then one neuron in qwen does way heavier lifting than a neuron in our brain.