Just crazy enough to use Proxmox on a desktop - by running the desktop OS under Proxmox KVM and using directvnc (DirectFB + RFB == No need for X!) to connect the VM display to the host display. Just experienced enough to make that work, even with some minor kernel recompilation for the needed drivers.
Still need to tweak the xmodmap, though. Still have some keys not translating correctly - including the apostrophe, which I cannot even type to identify it visually. :(