The piece you are describing is called a vacuum modulator. It is common for the rubber diaphram to get a leak in it. Change the modulator before yanking the trans...
Mark