Yeah, those little one-room air conditioners are one of the weirder things about Japan.
They have their advantages over central air (you only need to cool the rooms you're using; if one breaks you can just move to another room for a while) - and their disadvantages (no central control point; if you actually use them efficiently, you have to put up with a warm room for a bit when you first enter.)