It's maybe not a good idea to have an exposed live positive terminal. Particularly as there is no protection other than a melted wire and possible fire if the terminal shorts out.
You may find you have the cover floating around in one of your boxes, if not they are available.