Changing up without using the clutch is straightforward, changing down takes a bit more practise, forgetting what bike you're riding and attempting to go down 2 gears, clutchless, before entering a corner, can be entertaining.
As to damaging the 'box, if the change is smooth and silent, there are clearly no adverse loads.