I know what you mean. I have a Canon 5D and 7D, with several of their L series lenses. Awesome equipment, but hard, and expensive to pack around the mountain.
For a smaller point and shoot, I have been impressed with the Canon S series. I currently have the S120, but also owned the S95, and S100. They are compact, seem fairly rugged, and still have some manual operation options if you are into photography at that level(shutter speed,ISO,aperture, etc.) I also purchase this series because they have an underwater housing kit, that allows you to go 120 feet underwater, and he camera has an underwater setting, so I use it as my scuba cameras also.
Been good for me. Good luck