My thought was possibly a leaky brake booster as vacumn leak there will also cause you grief.