In my opinion you were right to apply caution at the crossing. You don't have to stop unless they put their foot on the actual crossing, but some people just don't care and I've seen several instances where they will make no allowance for the speed of an approaching vehicle; in this case, a cyclist.
However what this video clearly shows, is that the driver wasn't reading the road and WOULD have tried to over-take through a pinch-point - look at their position on the approach, they're practically running into the central reservation. That's not due to heavy braking - that's someone trying to squeeze past.
Not only that, look at what they do after: decides to over-take you whilst you're negotiating a parked vehicle (bus), in effect boxing you in whilst they loiter in the middle of the road. Anyone could step out in front of the bus or the bus could pull out hence the reason cyclists need space not only for themselves but to also stay as visible as possible to other road users.
Driver. If you don't like the cyclist's position and think it's fine to over-take where you shouldn't. If your thinking distance is insufficient then it is you who are the problem!
Were driving passed our gateway, but stopped and reversed back when they saw the gate had been left open.