Mike:

You're absolutely right. There's roughly 1/8" clearance from the bearing to the channel. I really don't know how much lateral sway to expect. My father was reconsidering this set-up though we never really discussed why.