I don't believe you have a complete understanding of the biology... i.e. mortality/natality.
If you believe in the free movement of wildlife populations in and out of private lands then... not killing animals on one side of the fence will, over time, lead to greater harvest on the other side of...