[pve-devel] backup : add pigz compressor

[Michael Rasmussen]

Problem with pigz is that it bails out on missing symbolic links. Eg. follow symlinks is on and cannot be disabled.

On July 10, 2015 6:51:21 AM CEST, Alexandre DERUMIER <aderumier at odiso.com> wrote:
>Hi,
>
>user from pve-user mailing report than using pigz (multithread gzip),
>improve a lot speed of compression backup.
>
>Maybe could we use add it ? (or maybe replace gzip ?)
>
>
>----- Mail original -----
>De: "Chidester, Bryce" <Bryce.Chidester at calyptix.com>
>À: "proxmoxve" <pve-user at pve.proxmox.com>
>Envoyé: Jeudi 9 Juillet 2015 20:30:30
>Objet: Re: [PVE-User] slow backup
>
>While this doesn't directly address the issue you're experiencing, it 
>may help slightly. 
>In my Proxmox deployments, I've replaced /bin/gzip with pigz ( 
>http://zlib.net/pigz/ apt-get install pigz ; ln -sfb /usr/bin/pigz 
>/bin/gzip). pigz is a multi-threaded gzip, and it significantly 
>decreased our backup times by speeding up the compression. We saw 
>backup times drop to just 10-50% of what they took running gzip. These 
>big, beefy virtualisation servers have all these CPUs+cores, so why 
>limit gzip to just one? 
>
>-- 
>
>Bryce Chidester 
>Director of Systems Engineering 
>Calyptix Security | Simply Powerful Network Security. 
>
>www.calyptix.com 
>
>
>On Sun, 2015-07-05 at 21:19 +0200, Tonči Stipičević wrote: 
>> Hello to all 
>> 
>> I'm using 4xIntelAtom CPU 2558 @2,4GHz on the host 
>> a backup storages are (1G) freenas nfs and local sata disk 
>> 
>> So classic backup (vzdump) of 32G image takes about 1h ... the same 
>> result to the nfs storage and to local sata disk 
>> I tried changing bwlimit in vzdump.conf the result is allways the 
>> same slow 
>> 
>> But Clone VM takes less then 10 min 
>> 
>> manual lzop backup of this image (nfs storage or sata disk) takes 
>> less than 10' too ... tar runs same fast 
>> 
>> So we cannot say tha CPU is not capable of doing archiving with 
>> commpression 
>> 
>> Why is backup so slow and what can I do to optimize it? 
>> 
>> thank you very much in advance and 
>> BR 
>> 
>> Tonci 
>> _______________________________________________ 
>> pve-user mailing list 
>> pve-user at pve.proxmox.com 
>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
>_______________________________________________ 
>pve-user mailing list 
>pve-user at pve.proxmox.com 
>http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 
>_______________________________________________
>pve-devel mailing list
>pve-devel at pve.proxmox.com
>http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

-- 
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

----

This mail was virus scanned and spam checked before delivery.
This mail is also DKIM signed. See header dkim-signature.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.proxmox.com/pipermail/pve-devel/attachments/20150710/7a7bc04e/attachment.htm>