points by TobTobXX 2 days ago | 0 comments
Is LFM3-Omni-2B worse or roughly equal at vision tasks compared to LFM3-VL-2B?
In other words: Should I select the model that matches my desired capability set or just use Omni?
[–] samstevens 2 days ago
[–] nostrebored 2 days ago
Is it a parameter count problem? Ie why are you not seeing the cross modality bump in performance?
[–] irthomasthomas 1 day ago
Has the cross modaility bump been conclusively proven?
[–] samstevens 1 day ago
my intuition is that cross modality improvements do not really show up in practice, and especially not in small models
It's a goal of ours to continue unifying training across modalities so that there is truly one model, instead of just this shared pre-trained backbone.