What sump to you have, and what type of oil do you use, and where do you ride?
BMW fitted these coolers for a reason and that is that the oil can get hot, and thin.
I have an oil temp and pressure gauge on both my G/S and GS and even with the cooler fitted what little oil is in the tiny GS sump gets dangerously hot. Removing the silly little sump shield and fitting the largest BMW sump has helped to keep the temp down, and I use Motul Ester synth Oil which is noted for it's high temp performance.
My G/S has a sump extender and the big sump but still gets what would be dangerously hot easily, if I was silly enough to use a cheap Dino oil.
Ok, I ride probably 60/40 on/off road, 100F days are nothing unusual in this part of Oz and I occasionally push on a bit, but the fact remains- they both get dangerously hot,
I dont think any of those that claim to have removed the cooler have ever claimed to have a oil temp or pressure gauge, and the statement that no one ever posts that they have blown their motor is a bit like saying no one ever posts that they have killed themselves by running tubeless tires on tube rims.
It sounds as if you have already decided to remove your cooler, and if as you say you only do gentle riding in a cool climate you will probably get away with it, in the same way that a cloth cap gives you the same protection as a crash helmet. Until the day you need the protection and then you will be glad you have the correct equipment.
If you remove the cooler then you should consider either a sump extender or a deep sump - Niche Marketing have a nice looking cheap deep sump for less than most charge for an extender, and everyone who sells aftermarket tuning parts sells a sump extender. For a good reason.