The database with reminders is stored on the installation folder which is usually located on the following partition: C:\Program Files (x86)\Personal Reminder. The file you need to copy as backup is db.dat. You can open it with any compatible text editor you have installed in your computer (ie Notepad).
