Thanks for the replies everyone. I had a different load worked up with Bergers, so I figured I'd just check velocities and go with it based on that. I know they're different loads and not comparing apples to apples, but here is what I had loaded.
162 eld-x with the IMR 4831 was running about 2,830 fps and shooting 1/2" groups.
168 berger with the H1000 was running about 2,970 fps and shooting about 5/8" - 3/4" groups.
I decided to go with the 168 berger. I know the groups are bigger, but for some reason, I'm just more confident with it. I feel like I can just stack them in there shot after shot after shot. I feel like I could just drop down, throw the gun down on my bag, and layer them in there for as many as I need to.