Can you still do some prn work if you take the desk job?
In my opinion, you should work while you can now to earn what you can now, and take the experience while there are opportunities. Later, you can get the desk job, but for more money, since you're more experienced.
Also, there are opportunities in research/real world evidence/device manufacturers/ software companies outside the healthcare systems for experienced clinicians like yourself (even fully remote ones).
Maybe this current role isn't perfect for you, but it started you wondering, and that's good.