To perform this operation connect the phone to the PC using the USB cable and enabled Mass Storage. In My Computer, you will see your phone with its storage drives available for use. Navigate to Card and copy all its contents on your PC for backup. Replace the card and copy the contents back.
Your contacts are not saved on the SD card. They are either kept in the phone's memory, Google account or on the SIM card.