As long as you keep the cam towers in order and torque them down with the cam in place, you'll be fine. I even made my own 0.080" cam tower shims (0.080" aircraft grade aluminum) and replaced and torqued them with no issues. By the way, the shims were to maintain cam timing after removing 0.005" from the top and 0.075" from the bottom of the head.