I'm in a room of a house and I steal stuff. The only other person in the room is my follower, so I think no one will find out. However, a guard shows up.
For example, in the House of Grey Mane:
No one else is there when I steal things, except my follower, but a guard shows up anyways.