Internet Explorer removal was implemented with the release of Windows 7 through the Turn off features option available in the Programs menu from Control Panel.
Also if you don't use Windows 7 or Windows 8 you can try using Revo Uninstaller. Even if it can't uninstall the application normally, it will force it to uninstall by wiping out all traces of its presence from the system.
After that, try running AdwCleaner to make sure that there are no leftover rogue registry keys or toolbars in your system.
