Bad pump or bad regulator.
Disconnect the line at the regulator and plumb the pressure gauge into the end of the line with no other outlet, just the gauge deadheading at the end of the line. Fire the pump and check the pressure. Then you'll know.