Please use a plastic primer on your panniers after cleaning , you can buy it in an aerosol. Also try and find some plastic cleaner, car paint stockist will sell both. When you flat them down use the plastic cleaner first, preparation is everything.
Get the product data sheets for them both, example, plastic primers need to be left a while before top coat.
Good primer and preparation means you can paint them with any top coat.