You are aware there are signs telling you to pull in and allow other vehicles past I assume ? Even if you aren't it's just common courtesy.
I suspect the point was that the whole set up would be too big for many passing places so no one could pass in any case. Time for a width or vehicle length restriction on some of the single track roads ?