I used an 11 year old phone for about 6 months while I waited to get a new phone. I never had any problems with processor speeds despite having about 60% the processing power of a then-current phone.
I think people vastly overestimate the need for a bigger better processor.