points by michaellee8 3 days ago | 0 comments
do people really use luna post 100k? small models generally seems to be hallucinating hard for me once you are over that threshold.
[–] rockdoe 2 days ago
[–] NewJazz 3 days ago
On purpose? I was using qwen3.8-27b the other day and very quickly ended up burning through half of the context (it has 128k total) pretty quickly. Not because of my directions, but simply because the codebase was very large.
[–] tepmoc 3 days ago
256k seems sweet spot. Even large codebase can be handled you just has to map out areas for agent. Anything past 256k usually exception than norm to be.
At least this my discovery when I did evals on my reviewers skills. 10k LOC is high end for high effort or around 150k context using opus. You can push towards 15k but that’s on max effort with about 400-500k ctx.
Fast models like haiku do not even need 1M ctx in my view
[–] NewJazz 2 days ago
Yeah codebase structure is very important. Admittedly, by large I mean average size but very poorly structured with a spaghetti (and sometimes cyclical) import graph.
[–] zahlman 3 days ago
Is there a straightforward way to check the current context window usage in the web chat interfaces, btw?
[–] rockdoe 2 days ago
In Claude it used to be the circle on the lower bottom, but now it's a bit more hidden and you have to expand the sidebar.
[–] NewJazz 2 days ago
I don't know, I usually use Pi.
200k also used to be the limit for Sonnet for a long time.
If Haiku 5.5 also had 200k, it'd actually be usable for us. As it is, it's Luna or Sol.