Yes, it is possible to disable the voice numbers in MuseScore for Windows. To do so, navigate to the "Edit" menu, select "Preferences," then go to the "General" tab. Under "Score," uncheck the option for "Show Voice Separator." This should disable the voice numbers causing the problem.
