The farthest I've traveled was London in 2005. Shameful, I know, but I've never had anyone to travel with and traveling on your own is scary.
My dad and my brother hate traveling, so my family has never done much in the way of traveling for vacations, either. My dad travels a couple of hours out of town once a year to stay with his aunt for a couple of days, and I'm convinced my brother will spend the rest of his life without ever going outside the country.
But yes, I will travel the world (or at least select parts of it) at some vague point in the future.