If solar time does not matter, why do you care about at when number you get up, go to work, come back and get back to sleep? This would be even more ridiculous. People care about the time, because it's a proxy for sun.