I have a similar outlook as elks96 even though I do have vacation time and I do hunt out of state most every year. I wish I would have realized the value of points sooner. I have bought points in Wyoming, I missed the first year so I sit with 7. I have about that many points in most the western states. I will retire in seven years and I will have some great hunts lined up.
Most hunters are banking points in Wyoming because of the upfront cost of applying for a tag. I can only speak for myself, the expense doesn't stop me. Its the uncertainty of drawing other states. I apply in Utah, Arizona, Oregon, and Nevada without sending in the tag fees. I send Colorado upfront fees for deer and elk to get a point, same with sheep in Montana.
I like Wyoming's system. I will apply when I have a chance to draw the tag and know I can go. I burned my antelope points last year and had a great hunt. I am to far behind in the sheep race so I will start applying for a tag in hopes of getting a random tag.
Since I have started my plan I have drawn, N.M. oryx, Idaho moose, Utah mule deer, as well as a couple Nevada tags. Arizona Elk is in the near future and it looks like we will try to burn our Wyoming elk points this year.
Stick with your plan elks96, your hunting future will be bright.