I always have Clairvoyance ready when I'm traveling across the map. But it seems that if I have magic ready, the other characters in the game remark that I need to be careful, I need to take my magic elsewhere, etc.
Does having magic or a weapon at the ready cause the other characters to he less hospitable towards me?