Thanks guys for the help, I don't think it will change it much, just was checking mainly to see if people had done this, don't think I'll have to shave much off to get it smooth, just really wanted a clean mating surface for the wheel to sit against... definitely will not have to do anything to the back side of the hub and the mating surface there, that looks really clean and good.
Jason