for that you would basically need portable apps (which GW is not) or you need to install an OS on your flash drive.
As mentioned earlier, if you don't want to do this, you could always just take the GW dat file so that you don't have to redownload all the game info.