If all we got out of LLMs was that non-game-developers could now build games then no, the negatives would not be worthwhile.

I'm currently of the opinion that all of the other positives outweigh the negatives. Furthermore, I think we can help push the balance to the positive by ensuring as many people can use this technology in as positive a way as possible.