I used to keep all my cards loose, but I discovered they're almost too small, and easy to lose. (I have the same problem with portable carts.)
so the ones I have cases for, stay in them. Sadly, I don't have too many of the outer boxes, but they're just an extra step in the process, so they stay separate.