If you use Windows XP or bellow you can go to Start > Control Panel > Add or Remove Programs. In the Currently installed programs box, click on the DivX program and then click Remove.
If you have Windows Vista or above you need to go to Start > Control Panel > Programs > Programs and Features. Select the DivX application and click on Uninstall.
Also you can use Revo Uninstaller. Even if it can't uninstall the application normally, it will uninstall it by wiping out all traces of its presence from the system.