on the way back from Wales last weekend I realised

that I had been drivng with the handbrake on (ok, its easy done

), rectified this immediately but when I went to brake for a roundabout the pedal just hit the floor - no brakes - pumped the pedal = brakes. This happened a couple of times so I stopped for break fluid thinking maybe it was low. Got the fluid, took the instrument panel off the dash but the fluid was fine.
Tried the brakes again...no problem....since then, absolutely no problem.. Was thinking maybe air in the system but surely if that was the case it would happen frequently not just a couple of times. And would still be happening?
Could this have just been linked to the fact that I was a numpty that forgot to take my handbreak off (wondered why van was so sluggish

) or is it likely to happen again and I should take it in to have brakes checked as matter of urgency?