Try using Revo Uninstaller. Even if it can't uninstall the application normally, it will force it to uninstall by wiping out all traces of its presence from the system.
To clean other registry items as well, run a copy of CCleaner using the Registry menu. In some cases you can simply use the program's uninstaller available through Control panel > Programs and Features > Uninstall a program.