I would leave it alone for several reasons.

1. A panhard bar will also move the axle slightly sideways because it swings in an arc - albeit a small one.

2. If you add a panhard bar, you'll have to replace the dead perch with a standard perch, otherwise, there will be a bind.

3. It's working for you now. If it ain't broke, don't fix it.