I like these kind of projects. While there are text descriptions that show the Turing completeness of transformers, making things like this make the implications obvious.

It helps address the 'just predicting the next word' argument suggesting they cannot possibly think.

When you can make a CPU like this, that's a clear enough display that it can do anything a computer can do. To say that LLMs cannot reach AGI is saying that no computer can.

Some people still think that, but this directly addresses the people who think computers might one day get there but LLMs never will.