[pve-devel] Error in PVE with win2008r2 and 256GB RAM
Cesar Peschiera
brain at click.com.py
Mon Dec 1 13:41:12 CET 2014
Hi Alexandre
Recently i have installed the kernel "pve-kernel-3.10.0-5-pve" version, and
now the behavior pf my VM is normal.... :-)
So my question is ¿can i do something for get a better performance
considering that will have MS-SQL Server?
The RAM will be distributed as follows:
- 8GB. RAM for PVE.
- 8 GB. RAM for the OS Win2008R2 VM.
- 248 GB. RAM for MS-SQL Server (into this VM)
A remembrance - Huge pages in RAM:
For get better performance in the VM that have the data base, how i can to
configure "huge pages" in permanent mode?
(If this will be better for the host and guest, so much the better).
Best regards
Cesar
----- Original Message -----
From: "Cesar Peschiera" <brain at click.com.py>
To: "Alexandre DERUMIER" <aderumier at odiso.com>; <pve-devel at pve.proxmox.com>
Sent: Monday, December 01, 2014 6:56 AM
Subject: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM
> Hi Alexandre
>
> I forgot tell you that with the code enabled:
> "push @$cpuFlags , 'hv_time' if !$nokvm;"
>
> The command "/etc/init.d/pvedaemon restart"
> Don't shows error messages.
>
> Question:
> Should I keep only this code enabled?
>
>
> ----- Original Message -----
> From: "Cesar Peschiera" <brain at click.com.py>
> To: "Alexandre DERUMIER" <aderumier at odiso.com>;
> <pve-devel at pve.proxmox.com>
> Sent: Monday, December 01, 2014 6:47 AM
> Subject: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM
>
>
>>I was performing your suggestions, but i get these error messages:
>>
>> shell# /etc/init.d/pvedaemon restart
>> Restarting PVE Daemon: pvedaemonBareword found where operator expected at
>> /usr/share/perl5/PVE/QemuServer.pm line 2639, near "#push @$cpuFlags ,
>> 'hv_spinlocks"
>> (Might be a runaway multi-line '' string starting on line 2638)
>> (Missing operator before hv_spinlocks?)
>> String found where operator expected at
>> /usr/share/perl5/PVE/QemuServer.pm
>> line 2642, near "if ($ost eq '"
>> (Might be a runaway multi-line '' string starting on line 2639)
>> (Missing semicolon on previous line?)
>> Bad name after win7' at /usr/share/perl5/PVE/QemuServer.pm line 2642.
>> Compilation failed in require at
>> /usr/share/perl5/PVE/VZDump/QemuServer.pm
>> line 14.
>> BEGIN failed--compilation aborted at
>> /usr/share/perl5/PVE/VZDump/QemuServer.pm line 14.
>> Compilation failed in require at /usr/share/perl5/PVE/VZDump.pm line 32.
>> Attempt to reload PVE/QemuServer.pm aborted.
>> Compilation failed in require at /usr/share/perl5/PVE/API2/Nodes.pm line
>> 25.
>> BEGIN failed--compilation aborted at /usr/share/perl5/PVE/API2/Nodes.pm
>> line
>> 25.
>> Compilation failed in require at /usr/share/perl5/PVE/API2.pm line 14.
>> BEGIN failed--compilation aborted at /usr/share/perl5/PVE/API2.pm line
>> 14.
>> Compilation failed in require at /usr/bin/pvedaemon line 14.
>> BEGIN failed--compilation aborted at /usr/bin/pvedaemon line 14.
>> (warning).
>>
>> So finally I revert the changes.
>>
>> Notes:
>> A) On PVE, I can to install the latest kernel version if will be better
>> B) The final target is use the RAM of this manner (The 256GB RAM of
>> Server):
>> For PVE:
>> - Use the OS (PVE) with 8 GB. RAM.
>>
>> For the VM:
>> - 8 or 16 GB. RAM for the OS (the VM share some necessary files)
>> - 248 or 240 GB. RAM for the MS-SQL Server
>> ( I want to use lots of RAM for MS-SQL Server... it will have more
>> reading
>> cache enabled )
>>
>> Some other suggestions?
>>
>>
>>
>> ----- Original Message -----
>> From: "Alexandre DERUMIER" <aderumier at odiso.com>
>> To: "Cesar Peschiera" <brain at click.com.py>
>> Cc: <pve-devel at pve.proxmox.com>
>> Sent: Monday, December 01, 2014 3:55 AM
>> Subject: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM
>>
>>
>> also, can you post your vm config file ?
>>
>> Proxmox use some hyper-v features to help for some case, including high
>> memory.
>>
>> But currently, 2 features are missing.
>>
>> in /usr/share/perl5/PVE/QemuServer
>>
>>
>> if ($ost eq 'win7' || $ost eq 'win8' || $ost eq 'w2k8' ||
>> $ost eq 'wvista') {
>> push @$globalFlags, 'kvm-pit.lost_tick_policy=discard';
>> push @$cmd, '-no-hpet';
>> #push @$cpuFlags , 'hv_vapic" if !$nokvm; #fixme, my
>> win2008R2
>> hang at boot with this
>> push @$cpuFlags , 'hv_spinlocks=0xffff' if !$nokvm;
>> }
>>
>> if ($ost eq 'win7' || $ost eq 'win8') {
>> push @$cpuFlags , 'hv_relaxed' if !$nokvm;
>> }
>>
>>
>> maybe can your try to uncomment
>> #push @$cpuFlags , 'hv_vapic" if !$nokvm; #fixme, my win2008R2 hang at
>> boot with this
>>
>> and restart
>> /etc/init.d/pvedaemon restart
>>
>> and start your vm again.
>>
>> (I think they was a bug in previous kernel, but maybe it's fixed now).
>>
>>
>> Another missing feature is hv_time, paravirtualized clock, but AFAIK it's
>> only work with 3.10 kernel.
>>
>> so, you can try
>>
>> if ($ost eq 'win7' || $ost eq 'win8') {
>> push @$cpuFlags , 'hv_relaxed' if !$nokvm;
>> push @$cpuFlags , 'hv_time' if !$nokvm;
>> }
>>
>>
>> ----- Mail original -----
>>
>> De: "Alexandre DERUMIER" <aderumier at odiso.com>
>> À: "Cesar Peschiera" <brain at click.com.py>
>> Cc: pve-devel at pve.proxmox.com
>> Envoyé: Lundi 1 Décembre 2014 06:47:35
>> Objet: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM
>>
>>>>3) In parallel to this strange behavior, htop on PVE is showing that the
>>>>process that consume a lot of processor is: "/usr/bin/kvm", this
>>>>behavior
>>>>is
>>>>repetitive in all threads of processor that the VM has access.
>>
>> The kvm process is your vm ;) (each guestvm is a kvm process)
>>
>>
>>>>4) In parallel to this strange behavior, while that the VM is configured
>>>>with 62GB RAM, htop on PVE is showing that the use of the memory is
>>>>growing
>>>>in each second that elapses, and when his memory bar say that have used
>>>>"63964/257912MB", the consumption of threads of processors of this VM
>>>>returns to normal state. While that the VM has more RAM, the behavior is
>>>>the
>>>>same, but the VM takes longer time to reach to a normal state.
>>
>> At boot, windows fill the memory with zero. and that's use cpu
>>
>> BTW, do you use balloning/dynamic memory feature of proxmox ?
>> can you try to add balloon:0 in your config. (to disable the balloon
>> device)
>>
>>
>>>>5) As a second test, after of see all these behaviours, I log to Windows
>>>>Server, and htop show me a high consumption of many threads of
>>>>processors
>>>>(+/- 50%), but after that the session was initiated, the consumption of
>>>>processors returns to normal state.
>>
>>>>6) In htop, i see the same behaviour of consumption of processor while
>>>>that
>>>>a session of windows is closing, i guess that any thing that i do in
>>>>this
>>>>VM
>>>>will consume processor resources extra needlessly.
>>
>> really don't known, this should require some cpu profiling inside
>> windows.
>>
>>
>>
>> ----- Mail original -----
>>
>> De: "Cesar Peschiera" <brain at click.com.py>
>> À: pve-devel at pve.proxmox.com
>> Envoyé: Lundi 1 Décembre 2014 06:35:14
>> Objet: Re: [pve-devel] Error in PVE with win2008r2 and 256GB RAM
>>
>> Hi to PVE team developers
>>
>> This is a new summary of a major problem between PVE, KVM and Win2008R2
>> SP1
>> VM.
>>
>> Maybe i am doing something wrong, or maybe PVE or KVM need some
>> corrections,
>> but i have done many test for get that the Win2008R2 SP1 works correctly
>> without successful, so that i would like consult about this to the PVE
>> developers
>>
>> Summary of the problem:
>> -------------------------
>> When i turn on the Win2008R2 VM, the cpu go to the 100% in use for each
>> thread enabled in the VM, and when the VM is configured for example with
>> 4GB
>> RAM, this VM works perfectly.
>>
>> This is my Hardware setup:
>> ---------------------------
>> - DELL poweredge R720 Server,
>> - Two processors Intel Xeon CPU E5-2690 v2 @ 3.00GHz., each processor has
>> 10 cores and 20 threads (Hyperthreading),
>> - 256GB RAM. in performace mode
>>
>> This is my Software setup:
>> --------------------------
>> - The Software is recently installed:
>> - PVE 3.3-5 (from his ISO and upgraded),
>> - Kernel: pve-kernel-2.6.32-34-pve,
>> - As VM: Win2008R2 SP1 using the 2 Intel processors and 248 GB RAM,
>> - VM without the use of tablet for pointer enabled in PVE (i use vmmouse
>> of
>> VMware).
>>
>> Here the symptoms and my actions performed:
>> -----------------------------------------------
>>
>> 1) Doing some tests, i have changed manually the size the page file of
>> Windows Server to 10 GB, and configured the VM with 62 GB. RAM (63488 MB.
>> RAM), now i can see that the Windows Server start with 100% of CPU, and
>> after of two minutes more or less, the processor returns to a normal
>> state.
>>
>> 2) Seeing the task manager of Win2008R2 VM (while all cores and threads
>> are
>> at 100%), i get this:
>> Image Name: System
>> User Name: System
>> CPU: 99%
>> memory (Private workspace): 52 KB
>> Description: NT Kernel & System
>>
>> All other processes are consuming 0% of CPU
>>
>>
>> Here comes the more important information of side of PVE,
>> and other actions performed:
>> ------------------------------------------------------------
>> 3) In parallel to this strange behavior, htop on PVE is showing that the
>> process that consume a lot of processor is: "/usr/bin/kvm", this behavior
>> is
>> repetitive in all threads of processor that the VM has access.
>>
>> 4) In parallel to this strange behavior, while that the VM is configured
>> with 62GB RAM, htop on PVE is showing that the use of the memory is
>> growing
>> in each second that elapses, and when his memory bar say that have used
>> "63964/257912MB", the consumption of threads of processors of this VM
>> returns to normal state. While that the VM has more RAM, the behavior is
>> the
>> same, but the VM takes longer time to reach to a normal state.
>>
>> 5) As a second test, after of see all these behaviours, I log to Windows
>> Server, and htop show me a high consumption of many threads of processors
>> (+/- 50%), but after that the session was initiated, the consumption of
>> processors returns to normal state.
>>
>> 6) In htop, i see the same behaviour of consumption of processor while
>> that
>> a session of windows is closing, i guess that any thing that i do in this
>> VM
>> will consume processor resources extra needlessly.
>>
>> 7) Moreover, while that the task manager of Win2008R2 VM says that have
>> +/-
>> 60GB free, PVE in his tag "Summary" says exactly the conversely.
>>
>> 8) Trying to solve the problem, i did the suggestions without successful
>> of
>> Mr. Spirit, according to this link:
>> http://forum.proxmox.com/threads/19309-Windows-KVM-frequent-restarts?p=99436#post99436
>>
>> Maybe KVM or PVE have problems for manage lots RAM memory with numa
>> enabled
>> in the bios of the Server, but in am not sure.
>> Only as a reference, i show this link:
>> https://bugzilla.redhat.com/show_bug.cgi?id=872524
>>
>> I will be very grateful I will be very grateful to anyone that may help
>> me.
>>
>> Best regards
>> Cesar
>>
>> _______________________________________________
>> pve-devel mailing list
>> pve-devel at pve.proxmox.com
>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>> _______________________________________________
>> pve-devel mailing list
>> pve-devel at pve.proxmox.com
>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>>
>
More information about the pve-devel
mailing list