In front of a crowd of 1,181, the Bulls raced into a two-goal lead, thanks to goals from Jordan Liburd after just 8 minutes and then top scorer John Mills right on half-time.
But, as often is the case, 2-0 leads at the break can be tricky, and so it proved as first Michael Gash 4 minutes into the second half and then Ryan Hawkins after 64 minutes pulled the hosts back on level terms before Toby Hilliard netted the winner deep into stoppage time.
The result ended Hereford’s amazing fifty-three away league game unbeaten run come to an end.
And they also lost third place to Weymouth after the Terras earned a good 2-1 win at Garden Walk against a Royston Town side who had previously lost only one in their previous eight games and were edging the top five themselves.
The Crows led at the break, courtesy of a looping header from John Frendo.
But 8 minutes into the second half, Brandon Goodship equalised and then won it for the visitors from the penalty spot in the 69th minute.
Chesham United moved into the top five after they beat third-bottom St Ives Town and Slough Town, who occupied the final play-off spot at start of play, were held to a 1-1 draw by another of the bottom four, Kings Langley.
At The Meadow, experienced striker Jefferson Louis gave the Generals a 22nd minute lead that Ben Crilley doubled after 33 minutes.
And Louis added a third in 15 minutes when he made it 3-0 on 37 minutes.
Oran Swales made it 4-0 and a comfortable win for the home side in the 73rd minute.
At Arbour Park, a crowd of 450 saw Kings Langley frustrate the Rebels, who took the lead on the half-hour mark through Alan Inns.
But Kings, who have held the top two to draws earlier this season, battled back and earned a share of the spoils through Matt Ball in the 73rd minute.