Sounds like your reg is older than the bottle. Burst discs do eventually go, due to fatigue or maybe if it was faulty.
Anyway, the one that has gone, you will see the hole in the bottom of it, when you take it out.
The disc should be captive to the brass bit, unlike on CO2 where the disc was separate and made of copper.
You could replace both. They will state on them what each is rated at. One will be 7.5k and the other about 2.5k or something similar for the low pressure side.