points by verdverm 4 days ago | 0 comments
> The cost of serving a model grows linearly with use (energy)
The cost of processing tokens however does not. Throughput and efficiency are improving around 10x per year. Hardware is not the only factor.
Aún no hay comentarios.