Leaving it late adds to the excitement of the game says Hereford's manager Pete Beadle.
The Bulls went a goal down 20 minutes into the game as Jack Edwards headed home a corner, with Harry White equalising from the penalty spot in the second half.
It was then in the 85th minute of the game when substitute Jamie Bird netted the winner with a speculative shot from outside the area.
"We gave away a poor goal on our part and the second half we came back into the game," Beadle said.
"I thought in the end we thoroughly deserved to win the game, but when you leave it late it's obviously always adds to the excitement.
"Paul [Holleran, Leamington manager] has got his team extremely well organised. We thought they would come and try to sit a little bit deeper and hit us on the break and look for set-pieces. They've got some decent-sized players in their side.
"It was a bit of a surprise when they got one from a set-piece because we said we need to make sure we're even more switched on with these because they've got some decent people to go and attack that ball.
"Martin has got to be a bit stronger than that as well, he's a big lad. He's 6'2"/6'3" and he shouldn't be getting pushed out of the way.
"It was a great header, Jordan [Liburd] lost his man and it was good to see the lads, for the first time this season, go one-down and have to claw their way back into the game."
Harry White equalised from the spot seven minutes into the second half after what appeared to be two handballs in the area from Leamington.
Firstly Eliot Richards' cross looked to be handled before Lance Smith's shot was once again met with a hand of a defender.
"We thought the first one was more of a handball because it was quite low down," added Beadle.
"The second one, we thought the ball was travelling out of the ground when it hit the lad's hand.
"The referee finally got one right. Poor tonight for me, the officials, for both sides of the pitch, them and us.
"He got the penalty spot on, it was a handball. First one was handball, second one was handball so he had to give one of them sooner or later and then well-dispatched by Harry."