Kettering, like Hereford, are out of the FA Trophy. The two teams meet at Edgar Street on Tuesday in the League.
However whereas Hereford went out on penalties, Kettering were soundly defeated 3-0 by Gloucester.
Manager Paul Cox has threatened changes.
"Too many times this season we haven't followed what we've been asked to do," said Cox.
"Too many players had off days."
Former Hereford striker Ollie Hulbert scored two of Gloucester's goals.
"The two boys that did the damage ran past a number of our players. They worked harder than us today. We didn't work as hard as we should have done today.
"I'm probably the most annoyed since I've been at this football club.
"I want hungery players, players who want to play in the Football League.
"I'm not having this lack of consistancy. Today we looked as though we couldn't buy a goal. We've let ourselves down today."
As regards Hereford on Tuesday.
"It's another game.
"I'd like to say we can't be as bad as we were today because we were poor.
"I'll pick a side to try and win the game on Tuesday so we might see a few new faces in."