Unfortunately, there is no portable version of AVG. I have searched their website and Internet and the only way to have it running from USB or CD is through the PortableApps website. I do, however, not recommend using it from third party websites.
Instead, create a RESCUE CD/USB to scan for malware. It's more effective this way.
Instructions page: http://free.avg.com/us-en/226162
