If you just fold a piece of paper , tape it and stick something in side and add a stamp will USPS still mail it?

I hardly ever mail something. Maybe once every 2 years and I don't want to buy a box of envelopes. Can I just fold a piece of paper tape the sides and stick a stamp on it. Mail a letter this way?
7 answers 7