You should ask about the total package and that means asking about bonuses before you start work. For example, do they pay other variable bonuses and/or performance bonus? $2k may appear low but if they follow the civil service's bonus structure the annual package may well turn out to be more than the other job that you are hoping to get.

Why don't you tell the other company that you need an answer by this week as you already have a job offer?