A friend of mine has no sense of direction. He also doesn't follow directions very well, which is annoying. He does use GPS, but uses an old Tom Tom that was several years out of date when he got it. He won't use any phone based GPS because we had a bad experience with Apple Maps when it was first launched, and we ended up following it's directions into a carpark. He won't have it that Apple have probably spent and awful lot of money improving Maps since then, and it's largely good, in my experience (I do use it a lot myself).
That's annoying, but when you give him directions manually, if he believes you and allows you to give directions without referring to his Tom Tom, you can't just say "Go up the road, and take the 2nd right", You have to wait until it's the next right, and say "take the next right". If he turns too early, and you end up somewhere where you shouldn't, that's your fault (as has happened when I gave directions).
Not surprisingly, if he offers to drive, I usually refuse now.