You will first need to install Windows Live Writer to obtain all of the program files (if you don’t have it installed already).
After you’ve installed Windows Live Writer, download WLWPortable3.zip and extract the contents to your USB drive. Finally, copy all of the files and directories from C:\Program Files\Windows Live\Writer to the WindowsLiveWriterPortable\App\WindowsLiveWriter directory on your USB drive. To run Windows Live Writer Portable, just launch WindowsLiveWriterPortable.exe from your portable drive.
Did it work for you? If not, leave a comment here and perhaps we can help you.