Upgrade from 4.x to 5.0: Difference between revisions

From Proxmox VE
Jump to navigation Jump to search
(Document the switch from cirrus to std VESA and its implication for live migrations)
mNo edit summary
 
(12 intermediate revisions by 6 users not shown)
Line 12: Line 12:


In both cases you'd better empty the browser's cache after upgrade and reload the GUI page or there is the possibility that you see a lot of glitches.
In both cases you'd better empty the browser's cache after upgrade and reload the GUI page or there is the possibility that you see a lot of glitches.
If you run a PVE 4 cluster it's [https://forum.proxmox.com/threads/4-4-and-5-x-version-in-the-same-cluster.37170/#post-182668 tested and supported] to add a PVE 5 node and migrate your guests to the new host.


=== Caveats to know before you start ===
=== Caveats to know before you start ===


* ''' if using ceph''',  upgrade your ceph cluster to the Luminous release '''before you upgrade''', following the article [[Ceph Jewel to Luminous]]. But be aware that the Ceph Luminous release, which is required for Proxmox VE 5.x, does not have a stable release yet as of 03/07/2017. For Ceph productive clusters, we recommend waiting for the release of ceph 12.2
* <span style="color: red">''' if using ceph'''</span>,  upgrade your ceph cluster to the Luminous release <span style="color: red">'''before you upgrade'''</span>, following the article [[Ceph Jewel to Luminous]].


== New installation ==
== New installation ==
Line 47: Line 49:
* Correct repository configuration
* Correct repository configuration
* at least 1GB free disk space at root mount point
* at least 1GB free disk space at root mount point
* ensure your /boot partition, if any, has enough space for a new kernel (min 60MB) - e.g., by removing old unused kernels (see pveversion -v)
* if using Ceph, you should be already running the Ceph Luminous version, but see the caveat above
* if using Ceph, you should be already running the Ceph Luminous version, but see the caveat above
=== Move important Virtual Machines and Containers ===
If any VMs and CTs need to keep running for the duration of the upgrade, migrate them away from the node that is currently upgraded. A migration of a VM or CT from an older version of Proxmox VE to a newer version will always work. A migration from a newer Proxmox VE version to an older version may work, but is in general not supported. Keep this in mind when planning your cluster upgrade.


=== Actions Step by Step ===
=== Actions Step by Step ===


All has to be done on each Proxmox VE node's command line (via console or ssh; preferably via console in order to exclude interrupted ssh connections). Again, make sure that you have a valid backup of all CT and VM before you start.
All has to be done on each Proxmox VE node's command line (via console or ssh; preferably via console in order to exclude interrupted ssh connections). Again, make sure that you have a valid backup of all CT and VM before you start.
Further, no changes to any guest, VM nor CT, should be made during the upgrade process.


==== Add the PVE repositories to you installation ====
==== Add the PVE repositories to you installation ====
Line 66: Line 74:


  sed -i 's/jessie/stretch/g' /etc/apt/sources.list.d/pve-enterprise.list
  sed -i 's/jessie/stretch/g' /etc/apt/sources.list.d/pve-enterprise.list
Add the Proxmox VE repository key:
wget http://download.proxmox.com/debian/proxmox-ve-release-5.x.gpg -O /etc/apt/trusted.gpg.d/proxmox-ve-release-5.x.gpg


More information about [[Package_Repositories]]
More information about [[Package_Repositories]]
Line 82: Line 94:


==== Upgrade the basic system to Debian Stretch and PVE 5.0 ====
==== Upgrade the basic system to Debian Stretch and PVE 5.0 ====
Before you can upgrade the system, you have to remove SysVinit.


This action will consume some time - depending on the systems performance, this can take up to 60 min or even more. If you run on SSD, the dist-upgrade can be finished in 5 minutes.
apt purge insserv sysv-rc initscripts openrc


Start with this step to get the initial set of upgraded packages.
Start with this step to get the initial set of upgraded packages:


   apt-get dist-upgrade
   apt-get dist-upgrade
This action will consume some time - depending on the systems performance, this can take up to 60 min or even more. If you run on SSD, the dist-upgrade can be finished in 5 minutes.


During either of the above, you may be asked to approve of some new packages replacing configuration files. Do with them as you see fit, but they are not relevant to the Proxmox upgrade.
During either of the above, you may be asked to approve of some new packages replacing configuration files. Do with them as you see fit, but they are not relevant to the Proxmox upgrade.
Line 112: Line 127:
==== Configuration defaults ====
==== Configuration defaults ====
===== Default display switched from 'cirrus' to 'std' =====
===== Default display switched from 'cirrus' to 'std' =====
''Since'': qemu-server 5.0-10


The default display is now 'std' (Standard VGA card with Bochs VBE extensions), changed from the 'cirrus' type.
The default display is now 'std' (Standard VGA card with Bochs VBE extensions), changed from the 'cirrus' type.
Cirrus has security bugs and 'std' is the default since qemu 2.2
Cirrus has security bugs and 'std' is the default since qemu 2.2


{{note|If you use the default value for the Display(vga) option of your VM, then the live migration of from a PVE 4.4 host to a PVE 5.0 will not work, as the VM on the PVE 5.0 will have a different hardware from the source host.
To still be able to simply live migrate VMs to another PVE 4, or an already upgraded PVE 5 host - without off time, ensure that your Proxmox VE 4 Node is '''up to date''', i.e. you ran an:
If you need to live migrate VMs between a 4.4 and a 5.0 node, you need to configure your VM as indicated in the steps below.}}
  apt update
 
  apt full-upgrade
Verify if I am using the Default option:
qm config <my_vmid> | grep ^vga ; echo $?
 
If the command returns '1' , then it means you're using the default value, and need to set a manual value for the live migration to work, following the steps below.
Any other value returned means that things are fine.
 
Now depending on if you can tolerate a shutdown of the VM you have two options:
* if a shutdown of the VM is acceptable. Simply power the VM off, migrate it offline to the target node, and start it again on the PVE 5 target node. The VM will run with the new default display, no editing of configuration needed
* if a shutdown of the VM is not acceptable at this point, follow the steps below.
 
Step to execute:
<ol>
 
<li>make a copy of the configuration file of you VM</li>
 
cp /etc/pve/qemu-server/<my_vmid>.conf  /etc/pve/qemu-server/<my_vmid>.conf.bak
 
<li>open the VM configuration with the editor of your choice ( nano, vim)</li>
 
vim /etc/pve/qemu-server/<my_vmid>.conf
 
<li>add the line</li>
 
vga: cirrus
 
</ol>
at the '''beginning of the file'''
 
with this operation done, live migration between a 4.4 and a 5.0 node is now possible.
 
At the next maintenance window, we recommend you to change to the default 'std' graphic adapter for the VM.


qm set -vga std <my_vmid>
cycle, with valid Debian Jessie and Proxmox VE 4 repositories configured!


and then poweroff the VM, and start it again. A reboot is '''not enough''' to reread the VM configuration file.
If you are using older package versions, for example qemu-server older than version 4.0-111, you will run into problems!


=== External links ===
=== External links ===
Line 161: Line 143:
*[https://www.debian.org/releases/stretch/amd64/release-notes/ Release Notes for Debian 9.0 (stretch), 64-bit PC]
*[https://www.debian.org/releases/stretch/amd64/release-notes/ Release Notes for Debian 9.0 (stretch), 64-bit PC]


[[Category: HOWTO]]
[[Category: HOWTO]][[Category: Installation]][[Category: Upgrade]]

Latest revision as of 08:14, 21 January 2022

Introduction

Proxmox VE 5.x introduces major new features, therefore the upgrade must be carefully planned and tested. Depending on your existing configuration, several manual steps are required, including some downtime. NEVER start the upgrade process without a valid backup and without testing the same in a test lab setup.

If you run a customized installation and/or you installed additional packages, for example for sheepdog, or any other third party packages, you need to make sure that you also upgrade these package to Debian Stretch.

Generally speaking there are two possibilities to move from 4.x to 5.x

  • New installation on new hardware (and restore VM´s from backup)
  • In-place upgrade via apt, step by step

In both cases you'd better empty the browser's cache after upgrade and reload the GUI page or there is the possibility that you see a lot of glitches.

If you run a PVE 4 cluster it's tested and supported to add a PVE 5 node and migrate your guests to the new host.

Caveats to know before you start

  • if using ceph, upgrade your ceph cluster to the Luminous release before you upgrade, following the article Ceph Jewel to Luminous.

New installation

  • Backup all VMs and containers to external media (see Backup and Restore)
  • Backup all files in /etc You will need various files in /etc/pve, as well as /etc/passwd, /etc/network/interfaces, /etc/resolv.conf and others depending on what has been configured from the defaults.
  • Install Proxmox VE from ISO (this will wipe all data on the existing host)
  • Rebuild the cluster if you had any
  • Restore the file /etc/pve/storage.cfg (this will re-map and make available any external media you used for backup)
  • Restore firewall configs /etc/pve/firewall/ and /etc/pve/nodes/<node>/host.fw (if relevant)
  • Restore full VMs from Backups (see Backup and Restore)

If you feel confortable with the command line, and all your VMs/CTs are one shared storage you can also follow the procedure Bypassing backup and restore when upgrading


In-place upgrade

In-place upgrades are done with apt-get, so make sure that you are familiar with apt before you start here.

Tip: You can perform a test upgrade and a standalone server first. Install the Proxmox VE 4.4 ISO on testing hardware, then upgrade this installation to the latest minor version of Proxmox VE 4.4 (see Package repositories), copy/create relevant configurations to the test machine to replicate your production setup as closely as possible. Then you can start the upgrade. You can even install Proxmox VE 4.4 in a VM and test the upgrade in this environment.

Preconditions

  • upgraded to latest V 4.4
  • reliable access to all configured storages
  • healthy cluster
  • no VM or CT running
  • valid backup of all VM (needed if something goes wrong)
  • Correct repository configuration
  • at least 1GB free disk space at root mount point
  • ensure your /boot partition, if any, has enough space for a new kernel (min 60MB) - e.g., by removing old unused kernels (see pveversion -v)
  • if using Ceph, you should be already running the Ceph Luminous version, but see the caveat above

Move important Virtual Machines and Containers

If any VMs and CTs need to keep running for the duration of the upgrade, migrate them away from the node that is currently upgraded. A migration of a VM or CT from an older version of Proxmox VE to a newer version will always work. A migration from a newer Proxmox VE version to an older version may work, but is in general not supported. Keep this in mind when planning your cluster upgrade.

Actions Step by Step

All has to be done on each Proxmox VE node's command line (via console or ssh; preferably via console in order to exclude interrupted ssh connections). Again, make sure that you have a valid backup of all CT and VM before you start. Further, no changes to any guest, VM nor CT, should be made during the upgrade process.

Add the PVE repositories to you installation

First make sure that your actual installation has the latest package of the Proxmox VE 4.4 release: 

apt-get update && apt-get dist-upgrade

Update the Debian repository entry to stretch. 

sed -i 's/jessie/stretch/g' /etc/apt/sources.list

Update the Proxmox VE repository entry to stretch. 

sed -i 's/jessie/stretch/g' /etc/apt/sources.list.d/pve-enterprise.list

Add the Proxmox VE repository key: 

wget http://download.proxmox.com/debian/proxmox-ve-release-5.x.gpg -O /etc/apt/trusted.gpg.d/proxmox-ve-release-5.x.gpg

More information about Package_Repositories

Replace ceph.com repositories with proxmox.com ceph repositories This step is only necessary if you have a ceph cluster on your PVE installation. 

echo "deb http://download.proxmox.com/debian/ceph-luminous stretch main" > /etc/apt/sources.list.d/ceph.list

If there is a backports line then remove it. Currently the upgrade has not been tested when packages from the backports repository are installed.

Update the repositories data: 

apt-get update

Upgrade the basic system to Debian Stretch and PVE 5.0

Before you can upgrade the system, you have to remove SysVinit. 

apt purge insserv sysv-rc initscripts openrc

Start with this step to get the initial set of upgraded packages: 

 apt-get dist-upgrade

This action will consume some time - depending on the systems performance, this can take up to 60 min or even more. If you run on SSD, the dist-upgrade can be finished in 5 minutes.

During either of the above, you may be asked to approve of some new packages replacing configuration files. Do with them as you see fit, but they are not relevant to the Proxmox upgrade.

Reboot the system in order to use the new PVE kernel

Troubleshooting

  • Failing upgrade to "stretch"

Make the sure that the repository configuration for stretch is correct.

If there was a network failure and the upgrade has been made partially try to repair the situation with 

apt-get -fy install
  • Unable to boot due to grub failure

See Recover_From_Grub_Failure


Breaking Changes in 5.0

Configuration defaults

Default display switched from 'cirrus' to 'std'

The default display is now 'std' (Standard VGA card with Bochs VBE extensions), changed from the 'cirrus' type. Cirrus has security bugs and 'std' is the default since qemu 2.2

To still be able to simply live migrate VMs to another PVE 4, or an already upgraded PVE 5 host - without off time, ensure that your Proxmox VE 4 Node is up to date, i.e. you ran an: 

 apt update
 apt full-upgrade

cycle, with valid Debian Jessie and Proxmox VE 4 repositories configured!

If you are using older package versions, for example qemu-server older than version 4.0-111, you will run into problems!

External links

Retrieved from "https://pve.proxmox.com/mediawiki/index.php?title=Upgrade_from_4.x_to_5.0&oldid=11276"