Each to their own.
Having done trips in full goretex when the weather is in High 20°s mid 30°s, I’ve learned to understand that it It is easier to “faff” taking layers off, than it is to be hot, sweaty and distracted by being in that position for hours on end.
You dress up with layers in the morning when there is a bit of a chill in the air, then a couple of hours later, when you’ve pulled in for a coffee (chances are you’ll take your goretex jacket off anyway) and take off a layer, whilst you are waiting for that coffee, pack your layer away. Same goes for the next stop and the one after…. Reverse order as temps get cooler. It isn’t really that difficult, it is just a mindset than need retraining. It is no different of you pulling over for a piss or to take a picture. A “faff” for those in your group, but a necessity in your mind.
I personally think that I am done with Gortex. I do not commute on the bike and for trips away, layering just works for me. I just look at the weather a couple of days prior to going away and pack accordingly, then during the tour, I look at the weather again and dress accordingly for that day too.