The most interesting part of this is normal LLM interacting with directly attached deterministic computation unit.

It's like successfully wiring your brain to a calculator.

I think it would cheaply provide LLMs a lot of benefit if we embedded in them directly a computer and a memory so they can internally process things predictably.

And some benefit is indeed shown even in this cursed experiment.