The problem is that this voice is the only one available for this phone. You can turn it off but it will not help you at all. In some cases there is Ellen voice available so you should check voice settings. A restart of your phone might be necessary.
This setting only changes voice Voice Commands and Message Reader. The built-in synthesized caller ID voice can't be changed.