I think you should call up the agency to resolve this issue. Anyway the rule of thumb is not to accept a counter-offer especially if
1. you are working in a big company or
2. you are not so close to your boss or
3. if you have asked for a raise before but was rejected or
4. you consider yourself as a potential target for retrenchement in the current company if times are bad