[PVE-User] slow backup
Tonči Stipičević
tonci at suma-informatika.hr
Wed Jul 8 19:37:40 CEST 2015
I have 2 cluster nodes (nothing special ... cluster out-of-the-box)
but only thing that differs from cluster otu-of-the-box would that I
have no linux bridges but everything is connected through ovs bridges (2
hosts -> 2 nfs storages 4 x teamed NICS in separate VLAN )
running backup (vzdump) on the other node ... the same slow again ...
host cpu does not go over 2-3%
But like I said, on the same network configuration , tar, gzip, lzo run
5 times faster ... for the same purpose
thank you
/
/
/srdačan pozdrav / best regards/
Tonči Stipičević
/direktor / manager/**
**
d.o.o.
ltd.
*podrška / upravljanje
**IT*/ sustavima za male i srednje tvrtke/
/Small & Medium Business
/*IT*//*support / management*
Badalićeva 27 / 10000 Zagreb / Hrvatska – Croatia
url: www.suma-informatika.hr
mob: +385 91 1234003
fax: +385 1 5560007
On 08.07.2015. 17:47, Francisco Romero | VOZELIA wrote:
> How many nodes do you have?
>
> Can you try to issue vzdump in other node?
>
> Regards.
>
> Vozelia
> *FRANCISCO ROMERO*
> IT TECHNICAL SPECIALIST
> francisco.romero at vozelia.com
> *Vozelia Telecom* - Avenida de Manoteras 8, Escalera 2, 2º B, 28050
> Madrid (Spain)
> Tlf.: (+34) 911 82 15 15 - Ext: 107 | web: www.vozelia.com
> <http://www.vozelia.com/>
>
> ------------------------------------------------------------------------
> *From: *"tonci" <tonci at suma-informatika.hr>
> *To: *"Gilberto Nunes" <gilberto.nunes32 at gmail.com>
> *Cc: *"Francisco Romero | VOZELIA" <francisco.romero at vozelia.com>,
> pve-user at pve.proxmox.com
> *Sent: *Wednesday, 8 July, 2015 16:18:37
> *Subject: *Re: [PVE-User] slow backup
>
> The same (slow) result I got when backing up to:
>
> 1. local storage (local hdd - ext4)
> 2. freenas NFS server ( 1Gbit)
>
>
> Not any sort of SAN device ...
>
> /
> /
> /srdačan pozdrav / best regards/
>
> Tonči Stipičević
> /direktor / manager/**
> **
>
>
>
> d.o.o.
> ltd.
>
> *podrška / upravljanje
> **IT*/ sustavima za male i srednje tvrtke/
>
> /Small & Medium Business
> /*IT*//*support / management*
>
> Badalićeva 27 / 10000 Zagreb / Hrvatska – Croatia
> url: www.suma-informatika.hr
> mob: +385 91 1234003
> fax: +385 1 5560007
>
>
>
> On 08.07.2015 16:03, Gilberto Nunes wrote:
>
> Just to clarify...
> Are you use NFS or some sort of storage???
>
> Is it a local storage? External USB HD??
>
>
>
> 2015-07-08 10:20 GMT-03:00 Tonci Stipicevic
> <tonci at suma-informatika.hr <mailto:tonci at suma-informatika.hr>>:
>
>
> Hello Francisco, Gilberto
>
> unfortunatelly result is the same ... speed never goes above
> 10MBs
> and CPU % usage is allways 5% at max and io-wait is allways 0%
>
> something is limiting me and I do not what
>
> Thank you in advance for any hint
>
> BR
>
> Tonci
>
> /
> /
> /srdačan pozdrav / best regards/
>
> Tonči Stipičević
> /direktor / manager/**
> **
>
>
>
> d.o.o.
> ltd.
>
> *podrška / upravljanje
> **IT*/ sustavima za male i srednje tvrtke/
>
> /Small & Medium Business
> /*IT*//*support / management*
>
> Badalićeva 27 / 10000 Zagreb / Hrvatska – Croatia
> url: www.suma-informatika.hr <http://www.suma-informatika.hr/>
> mob: +385 91 1234003 <tel:%2B385%2091%201234003>
> fax: +385 1 5560007 <tel:%2B385%201%C2%A0%205560007>
>
>
>
> On 08.07.2015 12:08, Francisco Romero | VOZELIA wrote:
>
> Hi,
>
> If you run vzdump on your local disk, do you got the same
> result?
>
> Regards.
> Francisco
>
> ------------------------------------------------------------------------
> *From: *"tonci" <tonci at suma-informatika.hr>
> <mailto:tonci at suma-informatika.hr>
> *To: *"Francisco Romero | VOZELIA"
> <francisco.romero at vozelia.com>
> <mailto:francisco.romero at vozelia.com>
> *Cc: *pve-user at pve.proxmox.com
> <mailto:pve-user at pve.proxmox.com>
> *Sent: *Wednesday, 8 July, 2015 00:00:17
> *Subject: *Re: [PVE-User] slow backup
>
> Hi Francisco
>
> I'm running latest version (enterprise-repo)
>
> Unfortunately I got the same result again ...
>
>
> thank you very much in advance
>
> BR
>
> Tonci
>
>
>
>
> INFO: starting new backup job: vzdump 100 --bwlimit 0
> --storage nfs05
> INFO: Starting Backup of VM 100 (qemu)
> INFO: status = stopped
> INFO: update VM 100: -lock backup
> INFO: backup mode: stop
> INFO: ionice priority: 1
> INFO: creating archive
> '/mnt/pve/nfs05/dump/vzdump-qemu-100-2015_07_07-20_39_41.vma'
> INFO: starting kvm to execute backup task
> INFO: started backup task
> 'ae0a136c-07f6-44f0-9367-b0837757e5c4'
> INFO: status: 0% (30932992/34359738368), sparse 0%
> (13627392), duration 3, 10/5 MB/s
> INFO: status: 1% (348192768/34359738368), sparse 0%
> (130928640), duration 37, 9/5 MB/s
> INFO: status: 2% (691994624/34359738368), sparse 0%
> (144646144), duration 79, 8/7 MB/s
> INFO: status: 3% (1034092544/34359738368), sparse 0%
> (152612864), duration 121, 8/7 MB/s
> INFO: status: 4% (1378156544
> <tel:%281378156544>/34359738368), sparse 0% (154607616),
> duration 165, 7/7 MB/s
> INFO: status: 5% (1722023936
> <tel:%281722023936>/34359738368), sparse 0% (160534528),
> duration 207, 8/8 MB/s
> INFO: status: 6% (2067267584/34359738368), sparse 0%
> (162983936), duration 249, 8/8 MB/s
> INFO: status: 7% (2408448000/34359738368), sparse 0%
> (166244352), duration 290, 8/8 MB/s
> INFO: status: 8% (2758344704
> <tel:%282758344704>/34359738368), sparse 0% (172875776),
> duration 334, 7/7 MB/s
> INFO: status: 9% (3098083328/34359738368), sparse 0%
> (177434624), duration 374, 8/8 MB/s
> INFO: status: 10% (3441491968
> <tel:%283441491968>/34359738368), sparse 0% (178905088),
> duration 416, 8/8 MB/s
> INFO: status: 11% (3786866688
> <tel:%283786866688>/34359738368), sparse 0% (180793344),
> duration 459, 8/7 MB/s
> INFO: status: 12% (4130734080
> <tel:%284130734080>/34359738368), sparse 0% (183898112),
> duration 499, 8/8 MB/s
> INFO: status: 13% (4466802688
> <tel:%284466802688>/34359738368), sparse 0% (185630720),
> duration 538, 8/8 MB/s
> INFO: status: 14% (4812439552/34359738368), sparse 0%
> (188973056), duration 579, 8/8 MB/s
> INFO: status: 15% (5154471936
> <tel:%285154471936>/34359738368), sparse 0% (191553536),
> duration 619, 8/8 MB/s
> INFO: status: 16% (5500370944/34359738368), sparse 0%
> (196132864), duration 660, 8/8 MB/s
> INFO: status: 17% (5842534400/34359738368), sparse 0%
> (202567680), duration 701, 8/8 MB/s
> INFO: status: 18% (6191710208
> <tel:%286191710208>/34359738368), sparse 0% (204541952),
> duration 742, 8/8 MB/s
> INFO: status: 19% (6530400256
> <tel:%286530400256>/34359738368), sparse 0% (207069184),
> duration 782, 8/8 MB/s
> INFO: status: 20% (6876168192
> <tel:%286876168192>/34359738368), sparse 0% (207560704),
> duration 823, 8/8 MB/s
> INFO: status: 21% (7218462720/34359738368), sparse 0%
> (213643264), duration 865, 8/8 MB/s
> INFO: status: 22% (7560495104
> <tel:%287560495104>/34359738368), sparse 0% (217743360),
> duration 907, 8/8 MB/s
> INFO: status: 23% (7906459648/34359738368), sparse 0%
> (220524544), duration 948, 8/8 MB/s
> INFO: status: 24% (8252358656
> <tel:%288252358656>/34359738368), sparse 0% (221818880),
> duration 990, 8/8 MB/s
> INFO: status: 25% (8596291584
> <tel:%288596291584>/34359738368), sparse 0% (222715904),
> duration 1031, 8/8 MB/s
> INFO: status: 26% (8935440384
> <tel:%288935440384>/34359738368), sparse 0% (223522816),
> duration 1074, 7/7 MB/s
> INFO: status: 27% (9285795840
> <tel:%289285795840>/34359738368), sparse 0% (225869824),
> duration 1116, 8/8 MB/s
> INFO: status: 28% (9621667840
> <tel:%289621667840>/34359738368), sparse 0% (228499456),
> duration 1159, 7/7 MB/s
> INFO: status: 29% (9972023296
> <tel:%289972023296>/34359738368), sparse 0% (229257216),
> duration 1201, 8/8 MB/s
> INFO: status: 30% (10312548352/34359738368), sparse 0%
> (229969920), duration 1240, 8/8 MB/s
> INFO: status: 31% (10659102720/34359738368), sparse 0%
> (235982848), duration 1285, 7/7 MB/s
> INFO: status: 32% (10999365632/34359738368), sparse 0%
> (249303040), duration 1325, 8/8 MB/s
> INFO: status: 33% (11348017152/34359738368), sparse 1%
> (504135680), duration 1362, 9/2 MB/s
> INFO: status: 34% (11688148992/34359738368), sparse 2%
> (844267520), duration 1395, 10/0 MB/s
> INFO: status: 35% (12028805120/34359738368), sparse 3%
> (1184923648), duration 1429, 10/0 MB/s
> INFO: status: 36% (12379029504/34359738368), sparse 4%
> (1535148032 <tel:%281535148032>), duration 1465, 9/0 MB/s
> INFO: status: 37% (12716605440/34359738368), sparse 5%
> (1860755456), duration 1499, 9/0 MB/s
> INFO: status: 38% (13057982464/34359738368), sparse 5%
> (1878110208 <tel:%281878110208>), duration 1540, 8/7 MB/s
> INFO: status: 39% (13406699520/34359738368), sparse 5%
> (1880797184), duration 1582, 8/8 MB/s
> INFO: status: 40% (13751549952/34359738368), sparse 5%
> (1881178112), duration 1624, 8/8 MB/s
> INFO: status: 41% (14090829824/34359738368), sparse 5%
> (1881948160), duration 1666, 8/8 MB/s
> INFO: status: 42% (14432468992/34359738368), sparse 5%
> (1882587136), duration 1713, 7/7 MB/s
> INFO: status: 43% (14775353344/34359738368), sparse 5%
> (1882738688), duration 1761, 7/7 MB/s
> INFO: status: 44% (15121383424/34359738368), sparse 5%
> (1883697152), duration 1810, 7/7 MB/s
> INFO: status: 45% (15466496000/34359738368), sparse 5%
> (1884278784), duration 1855, 7/7 MB/s
> INFO: status: 46% (15812591616/34359738368), sparse 5%
> (1888219136), duration 1896, 8/8 MB/s
> INFO: status: 47% (16155213824/34359738368), sparse 5%
> (1889505280), duration 1935, 8/8 MB/s
> INFO: status: 48% (16496918528/34359738368), sparse 5%
> (1891737600), duration 1975, 8/8 MB/s
> INFO: status: 49% (16839081984/34359738368), sparse 5%
> (1893085184), duration 2015, 8/8 MB/s
> INFO: status: 50% (17182752768/34359738368), sparse 5%
> (1895624704), duration 2054, 8/8 MB/s
> INFO: status: 51% (17528586240/34359738368), sparse 5%
> (1896615936), duration 2095, 8/8 MB/s
> INFO: status: 52% (17873633280/34359738368), sparse 5%
> (1899569152), duration 2136, 8/8 MB/s
> INFO: status: 53% (18214748160/34359738368), sparse 5%
> (1900761088), duration 2175, 8/8 MB/s
> INFO: status: 54% (18562678784/34359738368), sparse 5%
> (1935843328 <tel:%281935843328>), duration 2213, 9/8 MB/s
> INFO: status: 55% (18903072768
> <tel:%2818903072768>/34359738368), sparse 5% (1944649728),
> duration 2251, 8/8 MB/s
> INFO: status: 56% (19245039616/34359738368), sparse 5%
> (1946443776 <tel:%281946443776>), duration 2290, 8/8 MB/s
> INFO: status: 57% (19591004160/34359738368), sparse 5%
> (1948426240 <tel:%281948426240>), duration 2330, 8/8 MB/s
> INFO: status: 58% (19934871552
> <tel:%2819934871552>/34359738368), sparse 5% (1950769152),
> duration 2369, 8/8 MB/s
> INFO: status: 59% (20279263232/34359738368), sparse 5%
> (1952206848 <tel:%281952206848>), duration 2408, 8/8 MB/s
> INFO: status: 60% (20621557760/34359738368), sparse 5%
> (1955344384 <tel:%281955344384>), duration 2448, 8/8 MB/s
> INFO: status: 61% (20961755136/34359738368), sparse 5%
> (1960169472), duration 2488, 8/8 MB/s
> INFO: status: 62% (21307260928/34359738368), sparse 5%
> (1962774528), duration 2527, 8/8 MB/s
> INFO: status: 63% (21652635648/34359738368), sparse 5%
> (1970208768 <tel:%281970208768>), duration 2568, 8/8 MB/s
> INFO: status: 64% (21992046592
> <tel:%2821992046592>/34359738368), sparse 5% (1970520064),
> duration 2607, 8/8 MB/s
> INFO: status: 65% (22335324160/34359738368), sparse 5%
> (1971712000 <tel:%281971712000>), duration 2647, 8/8 MB/s
> INFO: status: 66% (22678732800/34359738368), sparse 5%
> (1975001088 <tel:%281975001088>), duration 2688, 8/8 MB/s
> INFO: status: 67% (23022731264/34359738368), sparse 5%
> (1978048512 <tel:%281978048512>), duration 2728, 8/8 MB/s
> INFO: status: 68% (23370203136/34359738368), sparse 6%
> (2091421696), duration 2768, 8/5 MB/s
> INFO: status: 69% (23709220864/34359738368), sparse 6%
> (2091651072), duration 2806, 8/8 MB/s
> INFO: status: 70% (24057151488/34359738368), sparse 6%
> (2285912064 <tel:%282285912064>), duration 2844, 9/4 MB/s
> INFO: status: 71% (24399380480/34359738368), sparse 6%
> (2309554176), duration 2882, 9/8 MB/s
> INFO: status: 72% (24749342720/34359738368), sparse 7%
> (2565627904), duration 2910, 12/3 MB/s
> INFO: status: 73% (25089671168/34359738368), sparse 8%
> (2905956352), duration 2927, 20/0 MB/s
> INFO: status: 74% (25431965696/34359738368), sparse 9%
> (3248250880 <tel:%283248250880>), duration 2940, 26/0 MB/s
> INFO: status: 75% (25772818432/34359738368), sparse 10%
> (3589103616 <tel:%283589103616>), duration 2969, 11/0 MB/s
> INFO: status: 76% (26121535488/34359738368), sparse 11%
> (3937820672), duration 3003, 10/0 MB/s
> INFO: status: 77% (26462912512/34359738368), sparse 12%
> (4279197696 <tel:%284279197696>), duration 3037, 10/0 MB/s
> INFO: status: 78% (26805862400/34359738368), sparse 13%
> (4622147584 <tel:%284622147584>), duration 3072, 9/0 MB/s
> INFO: status: 79% (27149926400/34359738368), sparse 14%
> (4966211584 <tel:%284966211584>), duration 3108, 9/0 MB/s
> INFO: status: 80% (27487961088/34359738368), sparse 15%
> (5304246272), duration 3141, 10/0 MB/s
> INFO: status: 81% (27833204736/34359738368), sparse 16%
> (5649489920), duration 3176, 9/0 MB/s
> INFO: status: 82% (28184543232/34359738368), sparse 17%
> (6000828416), duration 3213, 9/0 MB/s
> INFO: status: 83% (28527820800/34359738368), sparse 18%
> (6344105984 <tel:%286344105984>), duration 3246, 10/0 MB/s
> INFO: status: 84% (28865658880/34359738368), sparse 19%
> (6681944064 <tel:%286681944064>), duration 3281, 9/0 MB/s
> INFO: status: 85% (29213065216/34359738368), sparse 20%
> (7029350400), duration 3316, 9/0 MB/s
> INFO: status: 86% (29556604928/34359738368), sparse 21%
> (7372890112 <tel:%287372890112>), duration 3350, 10/0 MB/s
> INFO: status: 87% (29902176256/34359738368), sparse 22%
> (7718461440), duration 3386, 9/0 MB/s
> INFO: status: 88% (30244012032/34359738368), sparse 23%
> (8060297216), duration 3420, 10/0 MB/s
> INFO: status: 89% (30580473856/34359738368), sparse 24%
> (8396759040 <tel:%288396759040>), duration 3454, 9/0 MB/s
> INFO: status: 90% (30930239488/34359738368), sparse 25%
> (8746524672 <tel:%288746524672>), duration 3489, 9/0 MB/s
> INFO: status: 91% (31275220992/34359738368), sparse 26%
> (9091506176), duration 3524, 9/0 MB/s
> INFO: status: 92% (31613648896/34359738368), sparse 27%
> (9429934080 <tel:%289429934080>), duration 3558, 9/0 MB/s
> INFO: status: 93% (31963611136/34359738368), sparse 28%
> (9779896320 <tel:%289779896320>), duration 3593, 9/0 MB/s
> INFO: status: 94% (32298696704/34359738368), sparse 29%
> (10114981888), duration 3626, 10/0 MB/s
> INFO: status: 95% (32643678208/34359738368), sparse 30%
> (10459963392), duration 3662, 9/0 MB/s
> INFO: status: 96% (32996720640/34359738368), sparse 31%
> (10813005824), duration 3697, 10/0 MB/s
> INFO: status: 97% (33338687488/34359738368), sparse 32%
> (11154972672), duration 3731, 10/0 MB/s
> INFO: status: 98% (33680064512/34359738368), sparse 33%
> (11496349696), duration 3765, 10/0 MB/s
> INFO: status: 99% (34021048320/34359738368), sparse 34%
> (11837333504), duration 3800, 9/0 MB/s
> INFO: status: 100% (34359738368/34359738368), sparse 35%
> (12176019456), duration 3834, 9/0 MB/s
> INFO: transferred 34359 MB in 3834 seconds (8 MB/s)
> INFO: stopping kvm after backup task
> INFO: archive file size: 20.66GB
> INFO: Finished Backup of VM 100 (01:04:01)
> INFO: Backup job finished successfully
> TASK OK
>
>
>
>
>
> <https://play.google.com/store/apps/details?id=com.vozelia.app&hl=en> <https://itunes.apple.com/us/app/id971766501>
>
>
> ------------------------------------------------------------------------
>
> Este mensaje y, en su caso, los ficheros anexos son
> confidenciales, especialmente en lo que respecta a los
> datos personales, y se dirigen exclusivamente al
> destinatario referenciado.
> Les informamos que los datos contenidos en el presente
> mail, han sido facilitados por usted o recogidos de
> Fuentes Accesibles al Público. Dicha información personal,
> será incluida en un fichero bajo la responsabilidad de
> VOZELIA TELECOM S.L.Todos los ficheros que trata nuestra
> empresa se encuentran debidamente inscritos ante la
> Agencia Esp añola de Protección de Datos.
> Vd. Como propio interesado podrá ejercitar sus derechos de
> Acceso, Cancelación, Rectificación u Oposición, en el
> mail: administracion at vozelia.com
> <mailto:administracion at vozelia.com> o en la dirección
> Avenida de Manoteras 8 escalera 3 2ºB, 28050 Madrid.Tal y
> como establece la Ley Orgánica de Protección de Datos
> 15/1999 de 13 de Diciembre.
> Para ejercer sus derechos desde Panama podrá hacerl o en
> la dirección Vía Argentina, Edificio Mediteranean Loft.
> Panama.En caso de no ser el destinatario y haya recibido
> este mensaje por error, agradeceremos que nos lo comunique
> inmediatamente al remitente sin difundir, almacenar o
> copiar su contenido.
> La divulgación o el suministro, en todo o en parte, a
> cualquier tercero, no podrá ser realizada sin el previo,
> expreso y escrito consentimiento de VOZELIA TELECOM S.L. .
>
>
>
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com <mailto:pve-user at pve.proxmox.com>
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
>
>
>
> --
>
> Gilberto Ferreira
> +55 (47) 9676-7530
> Skype: gilberto.nunes36
>
>
>
> <https://play.google.com/store/apps/details?id=com.vozelia.app&hl=en>
>
>
> <https://itunes.apple.com/us/app/id971766501>
> ------------------------------------------------------------------------
>
> Este mensaje y, en su caso, los ficheros anexos son confidenciales,
> especialmente en lo que respecta a los datos personales, y se dirigen
> exclusivamente al destinatario referenciado.
> Les informamos que los datos contenidos en el presente mail, han sido
> facilitados por usted o recogidos de Fuentes Accesibles al Público.
> Dicha información personal, será incluida en un fichero bajo la
> responsabilidad de VOZELIA TELECOM S.L.Todos los ficheros que trata
> nuestra empresa se encuentran debidamente inscritos ante la Agencia
> Española de Protección de Datos.
> Vd. Como propio interesado podrá ejercitar sus derechos de Acceso,
> Cancelación, Rectificación u Oposición, en el mail:
> administracion at vozelia.com o en la dirección Avenida de Manoteras 8
> escalera 3 2ºB, 28050 Madrid.Tal y como establece la Ley Orgánica de
> Protección de Datos 15/1999 de 13 de Diciembre.
> Para ejercer sus derechos desde Panama podrá hacerlo en la dirección
> Vía Argentina, Edificio Mediteranean Loft. Panama.En caso de no ser el
> destinatario y haya recibido este mensaje por error, agradeceremos que
> nos lo comunique inmediatamente al remitente sin difundir, almacenar o
> copiar su contenido.
> La divulgación o el suministro, en todo o en parte, a cualquier
> tercero, no podrá ser realizada sin el previo, expreso y escrito
> consentimiento de VOZELIA TELECOM S.L. .
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.proxmox.com/pipermail/pve-user/attachments/20150708/01b61095/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 7689 bytes
Desc: not available
URL: <http://lists.proxmox.com/pipermail/pve-user/attachments/20150708/01b61095/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 7689 bytes
Desc: not available
URL: <http://lists.proxmox.com/pipermail/pve-user/attachments/20150708/01b61095/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 7689 bytes
Desc: not available
URL: <http://lists.proxmox.com/pipermail/pve-user/attachments/20150708/01b61095/attachment-0002.png>
More information about the pve-user
mailing list