Vineyard Vines is decent quality, but shouldn't cost what it does.
Stick with RL, since you know the level scheme, and don't forget you can find a lot of it on eBay. I have found, however, that the RL fabrics have gone downhill a lot in the last several years, except for black label.
A lot of these brands once had much better materials and now do not.
You might also look at buying Brooks Brothers stuff on eBay secondhand. They still use high end fabrics and tailoring, but it isn't flashy enough with kids, so it isn't resold for that much. Vineyard Vines isn't trash, but it's highway robbery.