My Internet Explorer 11 doesn't support Hindi font. I have done all operations like downloading new fonts, but it doesn't support it. It shows a square box.
Try installing the Hindi language in your Windows and then Internet Explorer will show Hindi characters properly. There is no need to mess with the fonts or something like that. Simply install the Hindi language, restart the PC and revisit the website with Hindi language.
You can find information about Hindi font on the following website: http://unicode.org/help/display_problems.html