Right on!!!...and while we return to the days without the IRS, let's forget about electricity, cars, planes, TV, computers, phones, the internet, antiboitics, etc.
Times change and so do the needs of a more complex society.
And there were taxes, just not on individuals. "For most of our nation's history, individual taxpayers rarely had any significant contact with Federal tax authorities as most of the Federal government's tax revenues were derived from excise taxes, tariffs, and customs duties." (Quoted from source)
And don't forget that in earlier times, most people struggled daily just to make ends meet...there was little time for recreation and pleasure except for the elite -- the top 1% -- and that ain't you and me!.