To remove the second cross labeled "reader" in OpenSong for Windows and fix the issue of double projecting song verses, you should go to the program settings or preferences. Look for an option related to projection or display settings, and ensure that the "reader" display is disabled or unchecked. This should remove the duplicate projection on the presentation screen.