I don't mind waiting a couple seconds for a music track occasionally, but when you're in town areas in DEII, every single house, hut, or doorway you enter cuts to chip music and when you re-emerge you have to wait for the CD track to cut back in. If it is between action areas that's OK, but considering how little most townies and hut-dwellers tell you, it gets frustrating.
So it's more the frequency with which you encounter this than that it happens. They should have muted the CD track but kept it playing so when you re-emerge from the house it doesn't have to re-track every time.