Shouldn't need a lot of clearance-maybe 1/16" to 1/8". If you had to pry on it to get the through bolt in, your pre-loading the master cylinder piston and that's not good. Shorten it 1/4", as you suggested, and then use the adjusting clevis to get the clearance correct.

Bob