I just went through the exact same problem. Same cam too.
I did not have enough retainer to guide clearance. Even though the measurement should give about .570 clearance and the cam with 1.52 rockers gave me the .060 @ .510 lift the umbrella seal are .100 THICK!!. Not enough to make noise but just enough to bend a rod here and there.