If it is a general sort of position then going back on your word has less repercussions. But if it is a niche industry where the players are few and you might actually cross paths with your erstwhile employers then think hard. You would be known as a not-very-reliable person who doesn't stick to his/her word.