But this is a different situation. Would you tell an amputee to break a leg? Or ask a blind person if they "see what I'm saying". I'm sure you could see how calling a single conjoined twin a "half" could be offensive.
Colloquials like that are a great way to make communication more colorful and informal, but sometimes you need to be a bit more sensitive with what you say.