Kidderminster, like Hereford, won't be in the quarter finals of the FA Trophy after falling to a 1-0 defeat at Peterborough Sports.
Harriers, who are struggling in the National League but have chalked up some wins under new manager Phil Brown, conceded an injury time goal against their lower-graded opposition.
The results from this afternoon's fifth round ties:
Welling United 0 - 3 Barnet
Bromley 2 - 0 Aveley
Hereford 0 - 1 Gateshead
Peterborough Sports 1 - 0 Kidderminster Harriers
Wealdstone P - P Hendon
Chorley 1 - 3 Solihull Moors
Bishop's Stortford P - P Coalville Town
Hampton and Richmond Borough 0 - 2 Macclesfield
Bromley 2 - 0 Aveley
Hereford 0 - 1 Gateshead
Peterborough Sports 1 - 0 Kidderminster Harriers
Wealdstone P - P Hendon
Chorley 1 - 3 Solihull Moors
Bishop's Stortford P - P Coalville Town
Hampton and Richmond Borough 0 - 2 Macclesfield