Those caps are not polarized.
Yes, the mute would turn it off, but the fade may keep it low. The fade effect occurs by simply switching from high-volume, to mid-volume, to zero-volume. So, maybe it's stuck at mid-volume.
By the way, there is an "anti-thump" circuit as well; it's another, albeit remote, possibility.
Charlie