I have a friend who was working at Roblox on in house classifier evals on texture generation (I think they were working with some enterprise version of Stable Diffusion?), specifically on adult content filtering and protected IP replication. That company seems predatory in many ways to me, but I'm pretty sure they aren't intentionally giving kids the ability to generate pornographic content on their platform.