Thanks, but that is not what I mean. It happened sometimes when I was simply walking in the streets, and it has happened several times when I walk in the front door of an Inn. This was in my first game though, haven't happened yet in my current one. Maybe I've trespassed their homes earlier, when I didn't know about the trespassing 'rules'?
Anyway I had a strange happening last night: I was exploring an old fort (the tower, not the inside), when suddenly a man came running down the stairs, ran right past me and headed for the woods. I ran after him, and when I caught up with him and talked to him, I got the 'Give me your money!'-dialogue!
I'm only level 3 in this game as well (and 0 fame), so he shouldn't be very afraid of me...