No, it won't be an issue.
The wheel is laterally secured by the bolts. Rotationally it is secured by both the bolts and the friction between the mating surfaces. So it's important that the mating surfaces are clean and that you evenly tighten the bolts to the correct torque.
Greg