[PVE-User] PVE kernel (sources, build process, etc.)

Marcus Haarmann marcus.haarmann at midoco.de
Wed Aug 22 11:08:20 CEST 2018


Hi, 
did you try this: 
(taken from the ceph list) 
This is PTI, I think.  Try to add "noibrs noibpb nopti nospectre_v2" to 
kernel cmdline and reboot. 

Did this make a difference ? 
We are struggeling with proxmox/ceph too and we have the suspect that it is kernel related or network related, 
but could not narrow it down to a specific reason. 
But the effects are different... We encountered stuck I/O on rdb devices. 
And kernel says it is losing a mon connection and hunting for a new mon all the time (when backup takes 
place and heavy I/O is done). 

Marcus Haarmann 


Von: "uwe sauter de" <uwe.sauter.de at gmail.com> 
An: "Thomas Lamprecht" <t.lamprecht at proxmox.com>, "pve-user" <pve-user at pve.proxmox.com> 
Gesendet: Mittwoch, 22. August 2018 10:50:19 
Betreff: Re: [PVE-User] PVE kernel (sources, build process, etc.) 

>>> 
>>>> * pve-kernel 4.13 is based on http://kernel.ubuntu.com/git/ubuntu/ubuntu-artful.git/ ? 
>>>> 
>>> 
>>> Yes. (Note that this may not get much updates anymore) 
>>> 
>>>> * pve-kernel 4.15 is based on http://kernel.ubuntu.com/git/ubuntu/ubuntu-bionic.git/ ? 
>>>> 
>>> 
>>> Yes. We're normally on the latest stable release tagged on the master branch. 
>>> 
>> 
>> I'll checkout both and compare the myri10ge drivers… 
>> 
> 
> What's your exact issue, if I may ask? 
> 
> cheers, 
> Thomas 
> 
> 
> 

Short story is that since updating from 4.13 to 4.15 I get slow_requests in Ceph with only low load on Ceph. If I boot back, those 
are gone. 

Or at least almost as I was able to produce slow_requests with 4.13 but only if deep scrubing was manually initiated on all PGs. 


Sage Weil (Ceph dev) suggested that this probably is MTU or bonding related and thus I'm currently testing with different 
settings. Another guy on the ceph-devel list suggested different driver versions so I was checking that as well. 



Long story is here: 

https://pve.proxmox.com/pipermail/pve-user/2018-May/169472.html 

https://pve.proxmox.com/pipermail/pve-user/2018-May/169492.html 

http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-May/026627.html 

http://lists.ceph.com/pipermail/ceph-users-ceph.com/2018-August/028862.html 

https://marc.info/?l=ceph-devel&m=153449419830984&w=2 
_______________________________________________ 
pve-user mailing list 
pve-user at pve.proxmox.com 
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user 



More information about the pve-user mailing list