To start mining with CGMiner on Windows, you need to download the latest version of CGMiner, extract the files, open a command prompt in the extracted folder, and run the command to start mining. The exact command may vary depending on your mining setup and preferences.