Have you ensured that the setting to use GPS rather than tower is enabled?
My experience was that the device resorts to use only cell towers when manifesting such inaccuracies (5 miles (!) off)