Would such a software work better with a smaller like 3b model and local knowledge base?