Alright just looked at the flywheel more carefully, I can see it getting chewed up near the front, so I am going to get some shims and try that.

Also is the torque converter supposed to be bolted up to the flywheel or just spin freely, because it isn't bolted up and it looks as if it used to have bolts in it?