I think your case is pretty much straightforward. Ask yourself this. Is jobless for months after graduation yet thinking about repaying school loan more worrying or not being able to take a short break after graduation more worrying?

One is a need, one is a want. Besides you get a headstart than your peers while some people are still struggling to land a job or even an interview. How is an immediate start a bad thing?

In your defence, unless the job is something that gives you no value in the future and you have another source for repaying school loan then yes you can afford to take a step back first.