Supports my hypothesis: incompetence.
However, once "the smoke clears," he should become aware of the fact that only treferring you to non-medical practitioners will not limit his liability.
Therefore, him not being a total dumb*ss, he should jump on the idea of him referring you to another doctor.