You may have limited access if you remove the speaker.
Marty : I thought of that also - However, the trick then is, how do you reinstall the speaker without being able to hold it from the back, in order to line up the holes in the lower door with the speaker's captive nuts so that the machine screws can be reinstalled ? Possible, yes with a little ingenuity, but definitely not easy without removing the actual door panel.
Bob