[–] SenHeng 13 hours ago
My American media consumption tapered off to mostly popular movies after the 00s so maybe there was a change after.
[–] trio8453 16 hours ago
I wouldn't put too much emphasis on pre-training data, there are so many steps afterwards in modern LLM development that completely change the output. Generally, if you're looking at LLM output in 2026 and thinking something along the lines of "this must be what humans were doing with their language in the training data", you need to pause and reconsider, because modern LLMs are much more than machines which repeat what was in the training data.
[–] bigwheels 10 hours ago
Discussed previously: https://news.ycombinator.com/item?id=48316504
The Why is the interesting part, and for that I don't yet know the answer.
[–] stuxnet79 11 hours ago
The fact that none of the frontier labs have done so is probably because it's another way to easily fingerprint their own slop. It's known that Anthropic already has a mechanism for ID'ing Claude output. As more and more of internet communication is mediated through agents, there is value in finding a way to prevent slop from being re-ingested during training and avoiding model collapse.
[–] 1broseidon 22 hours ago
Most of the large models collected data from marketing speak, opinion posts, etc (the whole internet basically). I feel like it’s a common sales pitch I’ve heard many times over - now it’s just compounded with everyone having access to the same pattern generator clanker
[–] byoung2 22 hours ago
[–] jumasheff 20 hours ago
[–] skyberrys 12 hours ago