. . . can I just leave that in or does it have to get replaced too?
The truth about seals is that the ones that look good aren't. The first corollary to that truth is that the one seal you don't replace will be the first one to leak. Seals are cheap. Replace 'em.