How do I uninstall a Kernel Extension in Yosemite?

I've recently reformatted my MBP to Yosemite and have run into an issue with my Logitech mouse. After doing some research I discovered that this is a longstanding issue. In the process of trying to fix this, I've installed (and tried to uninstall) several different driver kernel extensions.

I've removed these drivers from system preferences (by right clicking) but I've noticed that there are still the .kext files in /Library/Extensions folder.

Is it same to simply delete the related files and restart my computer to remove the extensions, or do I need to use some kind of tool to do so?