Your death knight could be in the inn. A hunter tending to his pets. A warrior training new recruits, or sparring with a training dummy. Your mage studying over a glass of ale in a tower. A druid caring for the garden.
Even if they added no bonus, it would make for great aesthetics to see that your characters aren't sitting around and are enjoying themselves even while you aren't playing them.