First, open Windows Live Mail and scroll down on the left to the Contacts section. Click it, and the contacts will be listed in the middle column. Select it and right-click the contact, then select Delete.
Depending on the way the contact is stored and maintained, you might see Windows Live Mail performing some online checks if the account is synchronized with the online service.
