How to unload a device driver

I’m getting some problems when trying to remove several device drivers that i don’t need anymore, because when i try to do so in device manager i receive a message stating that i “cannot remove it because it may be necessary for starting up the system”. I believe that this occurs because the devices are loaded at startup. How can i prevent them to be loaded so i can later unnistall them?