Hereford will face a replay against Ilkeston after a 1-1 draw at Edgar Street.
Tom Cursons gave Ilkeston the lead on 43 minutes after dominating large periods of the first half.
Hereford made three changes at the break and were rewarded with an equaliser on 64 minutes. Yusifu Ceesay fired home after Ahkeem Rose hit the post.
Cursons had two excellent chances to win the match for Ilkeston, while Aaron Skinner had a penalty chance denied late on, as the referee booked him instead.