[PVE-User] Kernel panic with 2.6.32-6-pve

[Shane Hathaway]

Hello,

I've been using PVE for over a year now and I love it!  Thanks for a 
great time saver.

PVE has been rock-solid stable for me until the latest kernel upgrade. 
With 2.6.32-6-pve, my servers seem to panic almost daily.  Fortunately, 
the 2 servers in question are stateless and redundant, so I have a 
little room to try out different kernels and configurations.

For the moment I have downgraded to 2.6.32-4-pve, which does not have 
the problem.  I intend to attach a serial cable next week so I can log 
the panics, then I'll upgrade one of them.  I did capture some warnings 
that happened 15 minutes before the panic.  I have attached one of the 
call traces.

I would love to hear any ideas for solving this.  Each server is a Dell 
PowerEdge R415 with 2 6-core AMD Opteron 4184s.  The servers are 
currently very lightly loaded.

Shane

Sep 16 09:15:54 wch6 kernel: ------------[ cut here ]------------
Sep 16 09:15:54 wch6 kernel: WARNING: at lib/list_debug.c:48 
list_del+0x71/0xa0() (Tainted: G        W  ----------------  )
Sep 16 09:15:54 wch6 kernel: Hardware name: PowerEdge R415
Sep 16 09:15:54 wch6 kernel: list_del corruption. prev->next should be 
ffff8803352c9d80, but was 80b531d800000000
Sep 16 09:15:54 wch6 kernel: Modules linked in: vzethdev vznetdev simfs 
vzrst vzcpt nfs lockd fscache nfs_acl auth_rpcgss sunrpc vzdquota vzmon 
vzdev ip6t_REJECT ip6table_mangle ip6table_filter ip6_tables xt_length 
xt_hl xt_tcpmss xt_TCP
MSS iptable_mangle xt_dscp sha256_generic cryptd aes_x86_64 aes_generic 
cbc vhost_net macvtap macvlan tun kvm_amd kvm vzevent ipv6 bridge 
iptable_nat nf_nat xt_limit ipt_REJECT ipt_LOG nf_conntrack_ipv4 
nf_defrag_ipv4 xt_state nf_conntra
ck xt_multiport iptable_filter ip_tables dm_crypt 8021q garp stp llc 
mptctl ipmi_devintf ipmi_si ipmi_msghandler dcdbas snd_pcsp snd_pcm 
snd_timer snd soundcore snd_page_alloc amd64_edac_mod serio_raw ghes 
edac_core edac_mce_amd k10temp
i2c_piix4 i2c_core tpm_tis tpm tpm_bios hed power_meter hwmon ext3 jbd 
mbcache dm_mirror dm_region_hash dm_log dm_snapshot pata_acpi 
ata_generic pata_atiixp mptsas ahci mptscsih bnx2 mptbase 
scsi_transport_sas [last unloaded: iptable_man
gle]
Sep 16 09:15:54 wch6 kernel: Pid: 53, comm: events/2 Tainted: G        W 
  ----------------   2.6.32-6-pve #1
Sep 16 09:15:54 wch6 kernel: Call Trace:
Sep 16 09:15:54 wch6 kernel: [<ffffffff81267a41>] ? list_del+0x71/0xa0
Sep 16 09:15:54 wch6 kernel: [<ffffffff81267a41>] ? list_del+0x71/0xa0
Sep 16 09:15:54 wch6 kernel: [<ffffffff810699a8>] ? 
warn_slowpath_common+0x88/0xe0
Sep 16 09:15:54 wch6 kernel: [<ffffffff81069afe>] ? 
warn_slowpath_fmt+0x6e/0x70
Sep 16 09:15:54 wch6 kernel: [<ffffffff814f25f2>] ? thread_return+0x4e/0x7ec
Sep 16 09:15:54 wch6 kernel: [<ffffffff81267a41>] ? list_del+0x71/0xa0
Sep 16 09:15:54 wch6 kernel: [<ffffffff8117444c>] ? free_block+0x8c/0x140
Sep 16 09:15:54 wch6 kernel: [<ffffffff81174751>] ? drain_array+0xa1/0x110
Sep 16 09:15:54 wch6 kernel: [<ffffffff81174a10>] ? cache_reap+0x0/0x2f0
Sep 16 09:15:54 wch6 kernel: [<ffffffff81174ab8>] ? cache_reap+0xa8/0x2f0
Sep 16 09:15:54 wch6 kernel: [<ffffffff81174a10>] ? cache_reap+0x0/0x2f0
Sep 16 09:15:54 wch6 kernel: [<ffffffff8108d1ce>] ? 
worker_thread+0x1be/0x2b0
Sep 16 09:15:54 wch6 kernel: [<ffffffff81093450>] ? 
autoremove_wake_function+0x0/0x40
Sep 16 09:15:54 wch6 kernel: [<ffffffff8108d010>] ? worker_thread+0x0/0x2b0
Sep 16 09:15:54 wch6 kernel: [<ffffffff81092e26>] ? kthread+0x96/0xb0
Sep 16 09:15:54 wch6 kernel: [<ffffffff8100c38a>] ? child_rip+0xa/0x20
Sep 16 09:15:54 wch6 kernel: [<ffffffff81092d90>] ? kthread+0x0/0xb0
Sep 16 09:15:54 wch6 kernel: [<ffffffff8100c380>] ? child_rip+0x0/0x20
Sep 16 09:15:54 wch6 kernel: ---[ end trace 5f5fdf805847564a ]---