What would I do?
The OP has quite a good plan and doable for sure without killing oneself.
I would start with the fact that he definitely wants to get to his house in Toulon by a certain date, leaving himself five to six days to 'Do chunks of the eastern side of France'. Let's says it's six days. Of these six two are to be spent in the Luberon, leaving four. Let's cheat a bit and say that the OP will accept one of the Luberon days as getting there, after all the Luberon is only a (smallish) part of the whole Provencal area which itself stretches from a long swathe of the Med coast to about Nyons in the north.
Basic maps are a great way to start.
Colmar
Route Napoleon
Provence
Luberon
I would then work out:
(i) What bits of the jaunt were most important to me. For instance, I have come through the Vosges in a morning (passing through Colmar on the way from the Black Forest) - so 'doing them' in a day or less - but on a quite separate visit spent three or four days riding around Colmar 'doing them' again, much fuller.
Similarly, I have ridden across Provence in a day several times and also spent two weeks there exploring on lots of occasions.
So, it's possible to do everything and nothing. It all depends on your time frame, what you might want to get out of it, stll have a holiday and hopefully stay married. The view I take is that France will not go away, so sometimes it's quite sufficient to pass through somewhere but making a note to (maybe) come back and see it again some other time, properly.
(ii) Having got the most important bits in place, I would then plot them up on a map to work out how to join them up without killing myself, staying married and having a half decent bit of holiday fun. I would also have have an eye that I need to get to Toulon, so I could mix in some great bits of Proevence to get there anyway.
Let's say for the sake of argument that the four main towns are:
Colmar, for the Vosges
Grasse (or maybe Catellanne) for having come down the Route Napoleon, with half an eye that you want to cut across to the Luberon.
Apt (a half decent town in the heart of the Luberon) or one of the very pretty satellite villages, perhaps? Sault (not in the Luberon, strictly speaking) is nice, has some small hotels and leaves you within easy striking distance of Mt Ventoux and Toulon. Both probably have a campsite not to far away, too. But the Luberon and Provence is littered with nice places, so you will find something super, I am sure. Gault is one of my favourites, cafe de la poste, for lunch.
Toulon, the end destination.
Now join them up with a decent map or two (see the sticky). But, here is the tricky bit..... Work out if you want to ride all day for hours on small roads, or leave at 11 to finish at four and have lunch and press wild flowers, or somewhere inbetween. Nobody knows what YOU want to do or how you want to do it. That is not a criticism nor a bad thing, simply as everyone is different.
I would accept a day on a motorway / fast N roads between points A and B if it got me to B in good time to do what I wanted to do the next day and / or got me to Toulon, which is really where I needed to be by a certain date. If I could do it with camping (and really wanted to camp, which is fine) great; if I couldn't great, too. Same with the D roads, too.
(iii) I would have half an eye, too, on the weather. Provence was sweltering at over 30c yesterday and the three or four days before. Much after 10:30 and much before 16:30 is hot work. Yup, you can ride in it (I have, several times) but it can slow you down, believe me.
====
Just like the UK, as a rough rule of thumb.
280 miles is a full day on D mixed with N roads.
400 miles is a full day on motorways, D and N roads.
By a full day I mean: Wheels rolling at 09:30, a decent coffee break of 30 minutes, an hour or so for lunch and a decent afternoon coffee stop for another 30 minutes. Finishing at about 18:00. That is very comfortable timing for sure but mix in picture stops and wild flower pressing..... and the clock will whizz round.....
====
PS Twit that I am, I forgot the very simple and obvious question!!!
What are you planning for the way back?