Interesting thing is that when I asked a follow up question it answered but showed: This answer came from what the AI already knows, not the library, so there's no source to check. Ask “look that up” to get one.
When I asked "look that up" it was able to. It highlights relevant sections.
The information it was working off in my case was WikiHow and there aren't any citations in that information.
Running on a 32GB Mac M1 using Qwen 27B. Ollama is showing as taking 19GB steady state and 23GB while answering on Activity Monitor (sometimes a little more and sometimes a little less).
Its amazing this can be done, but it seems like someone should be able to develop a much smaller model that can be used reliably for this use case. There are smaller models available to use and download but it is stated that they have some reliability issues.