Hacker News
points by jakswa 1 day ago | 0 comments
I'm testing this out as a dumb scout model alongside Qwen 3.8 Flash Next (IQ3_S, strata). Currently have it labeled as a "dumb but fast scout, findings should be verified" since some initial testing shows useful-but-sometimes-inaccurate.

on a 7900XT (20GB VRAM, ~800GB/s IO) w/ full context:

    - 8500 tok/s prefill/ingestion
    - 212 toks/s decode/generation
Aún no hay comentarios.
Hacker News