Legally, your contract only begins on the date you join.
So you still can inform the employer that you reject their offer.

However, in reality companies really do blacklist candidates.
(At least mine do)
So weigh your chances.