Is the small end hole tapered?
Yep. That's how a tie-rod end seats. Odds are you have the Pittman arm upside down . . . or bottomside up. Whatever . . .

If you have room, try putting a loose tie-rod end in from the top.