Hi Tim. I have exactly the same issue! 5m is often the distance the camera says it's focused on. Landscapes, and it's annoying. If using AF+MF I lose focus before I take a shot.
Both AF-s and AF-c I changed to 'focus' on the advice of a post elsewhere, but no difference.
I'm using 100-400 and 18-55 zooms.