If you live near a regional transportation hub it probably won’t make a difference on your delivery times. We dropped prime when our “1 day” deliveries kept turning in 3 day deliveries and never saw a difference.
And honestly a lot of the stuff I used to get on there isn’t even cheaper on Amazon anymore. Half the time if I check the manufacturer website they’re having a sale or have no shipping costs or cover returns longer, something like that. YMMV, you know your situation and needs better than me.