points by maxiR8 2 days ago | 0 comments
Is interesting how the live mode is restarting the text every 30 sec, wonder how it can impact a thing that may be agreed over several minutes.
Say I would like to get action items out of an hour long recording, am I supposed to go straight from the audio with LFM3-Audio-2B? Or is it transcribe first and give the text to LFM3-1.7B?
What if I want to fine-tune the action items routine. How many labelled examples do you estimate such task may need?
[–] samstevens 2 days ago
[–] maxiR8 1 day ago
Thank you for an update. Single step does sound exciting, look forward to check it out once I have the full system and data in place.
Would LFM3-Audio-2B provide timestamps and speaker labels for each action item? Did you guys train it for any of those?
[–] samstevens 1 day ago
unfortunately it's not a strong multi-speaker/diarized output audio model. It's a future goal but it doesn't have a timeline. If you have the hardware, I think fine-tuning might be possible.
1. I were building for my work laptop (M4 Max, 36GB RAM)
2. I had a batched use cases (transcribing + making action items for all meetings in a day)
I would use the LFM3-Audio-2B for ASR (audio -> text transcript) and then LFM3-1.7B for extracting particular action items and adding them to my tool of choice (Linear, Jira, Notes app, etc).
If you can fine-tune (100+ labeled samples, and a GPU), you likely can fine-tune LFM3-Audio-2B for audio -> action items in a single step.