try going into research / education / national archives / heritage board / museum / arts center / policy reformulation roles

i would think history majors have very good analytical and writing skills, so do look out for relevant corporate/admin roles. Take a look at careers@gov portal and sieve the jobs according to these types of roles. Good luck!