Hacker News
points by byoung2 23 hours ago | 0 comments
Remember in Jurassic Park where the dinosaur DNA was extracted from mosquitoes trapped in amber? That wasn't necessarily the best DNA, just the easiest to extract. The best writing might be love letters or high school term papers or PRDs meant for internal distribution, and these never get put online to be fed into LLM training sets. Instead we have 20 years of StackOverflow and Reddit posts saying "it's not a bug, it's a feature" or "Die Hard isn't an action flick, it's a Christmas movie" with 10k upvotes and LLMs learned that's how you get the biggest reaction with the least amount of words. It's not a bug, it's a...you get the point
[–] jumasheff 21 hours ago
Got it. Sigh... I wonder how these arguably extra tokens affect GPU utilization. So much waste!
[–] skyberrys 13 hours ago
Such a clean example and a funny reaction. It's true though. Do we get to complain when the problem is we built ourselves a mirror and wow does it reflect!?