You don't know because if a user removed your contact, you will also disappear from his Viber list. If you delete him, he can still see you because you, as a contact, are added into his phone book.
Other questions about "Can a deleted contact still contact you"
