If you have content attached to the application, make sure you unlock it and move it to another place. Alternatively, simple uninstall the application and then remove the folder. It's possible that the folder is locked because of the running application.