Yes, you can get rid of the application from your phone. Go to Settings > Applications > All tab. Locate the app and tap on it. Tap again on Uninstall and confirm the procedure.
If the icon is currently in use via phone launcher, change the icon theme to the default one in the launcher and then uninstall it.