Assuming this is a Chevy motor, the distributor should be connected to ported vacuum. That would be a port that registers almost zero vacuum at idle. The power brake needs manifold vacuum, which would be maximum at idle.