As far as I know, public service don't really look at the cover letters that much. For private, if you are a fresh graduate with no experience, you need a cover letter to explain why you are a good fit for the position and why they should hire you. Otherwise, it is very tough to stand out unless you have very stellar grades.