That’s why esp-idf has components. I have a bunch of components that are basically “compile if this SDK config is set, otherwise pretend you’re an empty file” using macros.

Then I just pull in all my components. The ones I use will get compiled, the ones I don’t won’t.

Mostly works fine. Eventually you will run out of NVRAM to save binaries on, but another esp-32 is like $3.