A plan to build a large number of new homes on a sensitive spot on the edge of Hereford is being scaled back in the face of official and public objections.