A late equaliser for Hemel Hempstead six minutes from time means there will be a replay at Edgar Street on Tuesday evening.
The FA Cup third qualifying round game between the step two clubs finished 2-2.
After being the better of the sides in the first half, Hemel Hempstead had the advantage at the break as Kyle Ajayi scored from a corner.
But into the second half, the Bulls equalised thanks to another superb Omari Sterling-James free kick in the 55th minute before Remaye Campbell put Hereford ahead seven minutes later.
But in the 84th minute, the hosts pulled themselves back level through Millar Matthews-Lewis.