There should also be a "cupped" washer that the felt fits in to retain it. There should be a "seam" on one face of the bearing, I usually put that facing down to minimize dirt accumulation. Make sure you align the notch in the kingpin toward the side with the retainer pin/bolt that goes through the axle as you slide it in. Then all you have to do is tweak it a bit with a drift to get the bolt to fully seat.