Hacker News
points by hardbass 2 days ago | 0 comments
How do you know an llm cannot create new content. Humans create what they do out of existing information and molecular and neural interactions, so do llms except with electrical interactions. I have had llms produce novel content all the time.
[–] whycombilater 1 day ago
You're confusing hidden relational information extracted from training data for "new content".
[–] hardbass 17 hours ago
How do you think humans generate new content? Do you think they get new information from thin air?
[–] whycombilater 14 hours ago
From their own subjective experience.
[–] hardbass 14 hours ago
Yes and? Still not seeing whats the special part you are seeing that's different here. LLM's have both the massive data they are trained on to draw from and working memory. I am not sure what this subjective experience you think is other than data and signals.
[–] whycombilater 9 hours ago
My subjective experience is mine, driven by me, and I record my thoughts about it on paper.

An LLMs experience is everyone else's subjective view of their history. It doesn't make its own and it never can.

An LLM is a clone of Guy Pearce trapped in a context window which is just reruns of memento with script variations.

[–] hardbass 3 hours ago
In what way do you think an LLM or an LLM instance doesn't have its own working memory and thoughts? Do you think there is telepathy involved where two LLM's communicate without any signal? What exactly difference does it make whether the experience is in your brain or some server?