points by ltbarcly3 15 hours ago | 0 comments
Gemini is the best at convincing you that you understand scientific concepts. Unless you have applied that knowledge in other contexts and been given feedback that your understanding is correct you have no idea whether it is good at actually explaining them.
[–] wasabi991011 14 hours ago
I had a research question in my area of expertise. Tried it with ChatGPT, Claude, and Gemini. I think all three could have solved the question, but ChatGPT was an unreadable mess with too many sections and headings, Claude got stuck thinking and never produced an output. Gemini gave succinct explanation that I think was similar to ChatGPT conceptually but that I was able to follow and verify. The answer was actually fairly trivial to understand; I just hadn't gone at the problem from that perspective.
I know it is common for people to try AI in domains they aren't experts in, but it is also common for people to use AI in domains they are experts in.
My experience with it is mostly using it against an actual, academic source, where I can easily tell if it starts making things up. I wouldn't rely on it for anything that I can't confirm myself.