Viber keeps the messages on the phone. Yes, that is a problem if you want the conversations gone. Use the file manager available on your phone and then navigate to Internal Storage.
Once you are on the Internal Storage location, scroll down until you see Viber directory. Long tap on it and then select Delete. Now, there is no other possibility of getting those messages back even if you use a recovery application.
