Is anything in the game based on time elapsed (except for the obvious stronghold build-times)? Can passage of time change the epilogue, influence quest outcomes etc?
It would seem that, when I can afford it, it would be prudent to just build my Stronghold as much as I can doing nothing but sleeping. Would there be any downside to that decision?