There are some things I do not think you should spend more than the bare minimum on. Children's t-shirts, for example: I recently saw an 8-year-old wearing a Gucci logo tee (plus Gucci leather boots and a Gucci belt - all be-logo-ed - just to make sure the point really hit home), and thought to myself jeez, I should really take her mom over to Target sometime because this is just as cute - a sloth!!! on a t-shirt!!! - and doesn't scream "I enjoy putting hundred-dollar-bills in garbage disposals."
Sweatpants, though? Sweatpants are different. "Dressy sweats" have been a thing for awhile now - WOOOOOO - and it's no longer all that hard to find a really, truly great pair of sweatpants that you can wear out of the house (or even out at night - even with heels!) and have it not look like an accident.