Hacker News
Show HN: I Turned DOOM into a Transformer(github.com)
55 points by falperc 4 hours ago | 12 comments
Instead of trying to run DOOM on things, I have instead decided to use DOOM (many, many, many doom games actually) to create a transformer. For a lot of the math required I essentially had to use DOOM game mechanics and voodoo dolls (DOOM is turing complete btw) and exchange them with the actual operations, essentially creating an alternative to NumPy (a 65000x slower one). Thus, I am proud to present DOOMFORMER. Here are a list of things DOOMFORMER can do :

It can classify MNIST digits, even if you write these digits on the map!

It can talk(kinda)

You can use it to make decisions, so, it can play DOOM. Yes! You can play DOOM with thousands of DOOM games now! The marine's mind can be controlled by DOOM, playing on a map generated by DOOMFORMER. Truly, the possibilities are endless, and even larger-scale training of DOOMFORMER could be done on a measly T4.

If anyone would like to help me scale this up and make crazier things, I'd love to work together.

[–] andai 2 hours ago
Awesome

>a handwritten digit takes 163 seconds of real-time DOOM in one map at the default schedule and 8 seconds at --opt 3.

What does this refer to? What does schedule mean here, and what are these opt levels?

Edit: oh sweet Jesus

https://github.com/mottopanikeiku/doomformer/blob/main/docs/...

[–] fwip 52 minutes ago
Oh, it's AI word-vomit.
[–] falperc 36 minutes ago
theres no pleasing you people do you expect me to write all my docs and disclaimers by hand
[–] fwip 13 minutes ago
It just means there's no sense trying to read the docs.
[–] slowin 2 hours ago
This is absolutely incredible. I feel like this could help visualize a neural network, but you have to know a lot about DOOM to really understand it.
[–] falperc 2 hours ago
you have to know a lot about lots and lots of DOOMs, in parallel
[–] stmonty 2 hours ago
Self-plug I have a very similar blog post title but a very different approach. Honestly, I like your idea more than my own idea. https://nostalgia.dev/posts/running-doom-inside-a-transforme...
[–] falperc 2 hours ago
what if you run doom on doomformer?

I havent fully recursed but what I have done with this is use a DOOMformer to generate a level, have python compile it, have DOOMformer generate the name of the level, and use a DOOMformer brain to complete said level. I have also trained said DOOMformer (you can see the levels "weights" updating as it trains) to aim better lol

[–] kenferry 3 hours ago
amazing
[–] saucesaft 3 hours ago
now everything can run on DOOM ?
[–] falperc 2 hours ago
you can theoretically build fable on doom