Training costs haven’t plummeted like they have for inference afaik and the efficiencies are just translated into running larger and longer training. Basically Jevon’s paradox in action just like on the inference side.