Most buildings are not historic. Protecting everything ruins the value for things that are worth protecting.

I have come to the conclusion that if it is worth protecting you can see it in tourist numbers - people who go out of their way to look at something.