The question is where such a lifestyle would lead you to ? where will you end up once you take this road ? will it lead to lasting peace and happiness, if yes, then it's ok to live such a lifestyle, the whole aim, object of our existence is happiness, if these things make you happy, nothing wrong in pursuing them.
But from experiences of countless people it is clear that such a lifestyle doesnt lead to lasting peace and happiness , gautam buddha is prime example of that, buddha was a prince he could have easily lived such a lifestyle but once he acheived enlightenment , nirvana he never went back to his kingdom , never went back to become a king, buddha achieved lasting peace and happiness without aid of sex, travelling, gluttony, drinking.
If you want to learn more about pitfalls of such a lifestyle google roman emperor nero, he was a perfect example of living only for sensory pleasures and his lifestyle brought tremendous misery to people around him and to himself too ( maybe thats why he indulged in sensory pleasures in first place ). nero and his end is the reason why one should stay away from excess of sensory pleasures.