They do, but compounding errors are always a problem with inertial navigation.
Instead of GPS, they can use fixed radio beacons like VOR and TACAN (which I think are both just US systems, but there are similar systems around the world and at major airports). This is basically the system that was in use before GPS.