Despite matching Gillingham at times throughout the first half, Hereford find themselves a goal down at the break.
The hosts, initially starting with five at the back before changing the formation after 15 minutes, have created their own chances but they haven't been strong enough to break the deadlock.
Jaden Clarke's deflected shot in the 22nd minute is all that separates the sides, with a later chance being denied by the crossbar.
Ethan Freemantle and Kyle Howkins have both gone close for the Bulls and it's all to play for in the second half.