points by dormento 3 days ago | 0 comments
There's also that paper "DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression" which got released some time ago. My take is the breakthroughs got quickly implemented and helped drive the inference prices down.
Edit: link to the paper
https://arxiv.org/abs/2609.19969
(it was published 2026-09-17)
[–] segmondy 3 days ago