Proxmox Disaster Recovery

I wrote about the newest addition to my homelab with the purchase of the JetKVM. I set things up and everything seemed to be working just fine but I always like to practice for an emergency when it comes to backups or data recovery. When an issue arrises I want to know what I am doing and that things will work. So here is a quick rundown of how I tested accessing my Proxmox VE host when for example after a kernel update or after changes to the GRUB bootloader the web UI/ssh won't be accessible:

  1. Boot with Proxmox ISO through the JetKVM and its Virtual Media feature

  2. In the installer select Advanced Options > Install Proxmox VE (Debug Mode)

In the console

Now with the installer started in Debug Mode a console is available which we can use:

exit
/sbin/modprobe zfs # load zfs
mkdir /RESCUE # create mount point
zpool import -f -R  /RESCUE rpool

Please note this is specific to my ZFS pool setup and might differ for you if you either do not use ZFS or have a different pool name in your installation.

Now make the necessary changes in the directory /RESCUE to fix the installation.
Then start Proxmox again via:

cd /
zpool export rpool
reboot

Lets just hope I will never need this for my production server but when I do I will be more than happy to have tested it works as expected.

Posted in homelab