I recently watched a YouTube essay about this and completely agree. Luckily my foot isn't wide, so the shoes that I wear as my dailies don't push in my pinkie toe at all even though it doesn't have a particularly wide toe box, just a mix of soft flexible fabric and a slightly bigger size.
The video I watched does recommend a few shoes for people like you, I'd be happy to find it and send it if you'd like :)