I would rather not have to listen to other people wittering while I am riding. No coms for us. We have our own way of communicating. Tap on the right shoulder, turn right. Tap on the left shoulder, turn left. Thump in the back, slow down.
Fairs. I felt the same but would rather have it nowadays. Alerting others to road dangers, route changes, the presence of Police and/or cameras, the reason why we are stopping and that a coffee break venue is being sought, IMHO, outweigh any disadvantges that you mention. I respect your quest for a quiet life.