Israel left Sinai ("To the last grain of sand") in the peace treaty with Egypt. And this treaty was signed by the right winger Begin.
Dayan indeed said in 1971(?) that Sharm El Sheikh with no peace is better than peace with no Sharm El Sheikh. But 7 years later he was one of the negotiators in Camp David.