I have installed the software and checked to see if I could configure the output options, but there is no menu or possibility to do that. By default, JellyCam exports to FLV that can be uploaded to YouTube. The best way to improve your video is by using a quality webcam to record in HD and then the output file will have an increased quality as well.
For additional options, consult the website: http://ticklypictures.com/projects/jellycam/
