Hard to say without looking at it. My guess would be a bearing is damaged. You are probably pulling it out far enough to where the cam has to fit through the "Next Set" of bearings for lack of a better term. If it were mine and I wanted the engine to last, I would bite the bullet and pull the engine n' tear it down. If the cam is bad you've got filings in the engine and probably embeded in the bearings ....cam, rods and mains.