LLMs occupy a different niche from other deterministic doohickeys. They are sold as replacing human thought and judgment and so they should themselves be judged by their output... just like the humans they replace.