A lot of this comes from my own experiences in Japan.  Even a regular white guy is enough of an oddity in Japan to get some looks.