Sounds like bump steer to me. That's usually a sign that the a-arm geometry is out of wack. I don't know enough to explain out of wack in words though.