After trying to boot from a live CD image, pretty Esc frantically to get into the grub boot menu and trying to find boot parameters that would boot the VM into rescue mode, I finally found the answer…

In XenCenter, go to VM > Start/Shutdown > Start in Recovery Mode

Annoyingly that simple.