The 32X has a number of good games on it. It has the definitive version of Virtua Racing, for instance.
I would not have been happy spending $160 on it new back in the day, but for what it goes for now, it pays for itself in fun. Especially if you have an Everdrive.
Even with Virtua Racing there's the Saturn version. Kolibri is the only reason to own a 32X, and even then, that's not that much of a reason.
Kolibri that's the shooter where you are a hummingbird right?
It could be that I have no exposed to the 32X or anything I can recall seeing that makes me say YES! That game makes it worth while.
For me honestly if I can find even one game on a system or add on that makes it worth while I usually go for it if even just to experience the game.
Initally it was Sonic CD that made me want a Sega CD but man it has so many other good games on it I am amazed when people say it is not a worth while add on.
I simply never hear anything much in support of the 32X. But hey maybe one day I'll see one demoed that I can try out before I buy.
The podcast "Retro Game Squad" recently did an episode about the 32X, and they talked about a number of games that they liked. If you're into podcasts at all, you might want to give it a listen.
I think I am a lot like you in that it only really takes one good game to give me a reason to buy a system. But generally once I do that, I find other games that I think are cool. But I think I have a higher tolerance level for "bad" games because I can (and like to) appreciate them in their own time. For example, people constantly talk about how poorly the original Playstation has aged. But that thing was my jam in the late 90's, and I don't feel any differently about it when I play the games now. But I completely understand why other people wouldn't feel that way about it.
It's funny that the Jag, 32X, and 3DO are all these maligned systems now. When you think about it, they almost make up a little mini-generation of consoles, in that they all bridged this short gap between the decline of the 16-bit era, and the heyday of the Playstation. All three of those consoles looked f*cking awesome in 1993 and 1994 because they were doing things that blew the Genesis and SNES away, in audio-visual terms. But then the Playstation and Saturn came out and pretty quickly made those systems obsolete.