Neither have right of way, at any time; rather, it is a case of who has prority. Looks like he expected you to brake for him.
Also, Road Tax was abolished in the 1930's. Those who post it around including certain car check websites, are spreading fallacy. The tax is on the car's emissions - not on roads. Not having a go at you by the way, just get pissed off at the lies being peddled about this mythical tax, I agree about the driver now waiting, he should have held back as there was oncoming traffic, which had priority.
They did make it past. What's wrong with you?