Which tees should I use?

So my brother and I were discussing the tees we should use. I said white because we stink but aren’t seniors or women. He said you should play as far forward as you can until you start playing well and progress backwards. Basically, red/gold/white shouldn’t be considered by gender or age, but by skill, e.g., crap/better/decent. Thoughts?