You should keep the wedges even if you change latches. They keep the door in alignment and prevent shakeing and rattling. Removing them will also cause stress cracks around the hinges and the doors will droop when opened.