Wouldn’t go for a full ARM64 system (yet anyway). Too many software incompatibilities. You can pick up the lenovo m-series tiny machines used for dirt cheap and have full x86 compatibility and way faster specs + expandable storage/ram for (m93p tiny, m700, m720 etc). They’re a little bigger than a rpi and use a bit more power but it will save a ton of headaches.
Making the switch to any linux distro is a big jump already, you don’t want to create unnecessary problems.