It is the Chromebook / Tablet addon idea.
Keep your desktop with all ssh keys, openvpn connections, browser, links (saved passwords) and files save at a usb stick.
Connect the usb stick to your portable device, ssh to it and work with your trusted environment.