Why is that a condition? If you want to go from country A to country B, you need country B's permission. There are many cases where this permission is granted semi-automatically, and thus you tend to ignore it.
When country A and country B don't like each other, it's a problem. Try to see what it take for Indians to visit Pakistan and vice versa.