Since there is no automated fix, you will need to specify for the most common applications that you use how should Window open them with the required software.
On the other hand, uninstalling the application through Control Panel could be a possible solution but if you're not comfortable with this then you can use an advanced uninstaller. Revo or Your Uninstaller are two possible software that you can use.