The oil breather cap on the oil filler tube should be for air intake. The metal cap on the back of the block, next to the distributor, should be connected to the carb via a pcv valve, and draws air out. As stated, if this is missing or plugged it will cause pressure build-up as you described.

Chevy used two systems: Open and Closed. You have the Open type.