Hacker News
points by LoganDark 22 hours ago | 0 comments
Assuming for simplicity that you're talking about locking layers. Each layer influences the input to the next layer, so locking a subset of layers doesn't necessarily mean that you'll continue to see the same results in the output. Not sure if you meant something more granular or otherwise, but I don't see how it's possible to simply freeze a part of a model in order to retain a particular capability.
[–] im3w1l 17 hours ago
I meant taking all the weights that are part of the cpu and locking those, and only those.
[–] LoganDark 16 hours ago
Ah wait, you mean you'd intend the other layers to be able to evolve to use the CPU internally, so all you need is to keep the CPU functional somewhere in the model? That may work, dunno.