Yes, if you don't have $6m, or even $2m, just live within your means. $6m networth people will lead their own retirement lifestyles. You don't have to follow them.

Don't be jealous, tell me how much you earn and what is your networth and I can help you plan for a worry free retirement.