I've frequently had an expression of surprise walking into a store or restaurant in small town America, simply because I have an English accent. It's never even crossed my mind that it might bother me. I don't think brief surprise at the sight or sound of a foreigner is particularly unusual. It's just a natural reaction to something you don't see often.

Quote Originally Posted by Maciamo
I didn't mean that people gave me the "you couldn't possibly know what you're talking about" look. It's more than many look genuinely surprised that after 2, 3 or 4 years in Japan I can speak Japanese at a reasonable level, read a menu in Japanese, or know where Kobe or Aomori (or any other city) are. This expression of surprise on their face always makes me feel like they first thought I was the last of the idiot.
How on earth are they supposed to know how long you've been in Japan? You could have been a tourist fresh off the plane.