I know the feeling. We were looking over a ton of deer last weekend, with numerous spikes, forkies, and young three and four points. When we finally saw a big mature buck we thought, what if we did kill this buck. We'd be taking out the only big breeder buck in the area. Luckily for the buck we are bow hunting and it didn't work out, so he gets a chance to breed some more does before this weekend, when we'll try again.
I understand what you are thinking but we both proved what people will do given the opportunity. We both had thoughts that the deer herd is struggling and still opted to go after the buck because the opportunity was there. Everyone else would do the same. I would hope that big game managers would make a change to their management plan before the majority of hunters were having these kinda thoughts.