[pve-devel] pve-kernel-4.4.10-1-pve woes
Michael Rasmussen
mir at datanom.net
Mon Jul 4 08:09:29 CEST 2016
On Mon, 4 Jul 2016 07:42:51 +0200
Fabian Grünbichler <f.gruenbichler at proxmox.com> wrote:
> detailled logs and/or stack traces would of course also be welcome.
>
Sorry, forgot. Here comes an example:
Jul 3 12:13:11 esx2 pvedaemon[16674]: <mir at pam> starting task UPID:esx2:0000322A:087D3C37:5778E537:vzstart:146:mir at pam:
Jul 3 12:13:12 esx2 kernel: [1424288.174012] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
Jul 3 12:13:13 esx2 pmxcfs[1806]: [status] notice: received log
Jul 3 12:13:13 esx2 pveproxy[12159]: EV: error in callback (ignoring): connect to 'localhost:5900' failed: Connection refused at /usr/share/perl5/PVE/HTTPServer.pm line 405.
Jul 3 12:13:13 esx2 kernel: [1424288.474763] IPv6: ADDRCONF(NETDEV_UP): veth146i0: link is not ready
Jul 3 12:13:13 esx2 kernel: [1424288.997254] device veth146i0 entered promiscuous mode
Jul 3 12:13:13 esx2 kernel: [1424289.080912] eth0: renamed from veth9BPVKJ
Jul 3 12:13:15 esx2 kernel: [1424290.506027] audit: type=1400 audit(1467540795.218:6): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/sys/fs/cgroup/" pid=12907 comm="systemd" flags="ro, nosuid, nodev, noexec, remount, strictatime"
Jul 3 12:13:22 esx2 kernel: [1424297.575464] nfs: server omnios not responding, still trying
Jul 3 12:13:22 esx2 kernel: [1424297.575653] nfs: server omnios not responding, still trying
Jul 3 12:13:22 esx2 kernel: [1424297.575704] nfs: server omnios not responding, still trying
Jul 3 12:13:26 esx2 pvedaemon[13326]: starting lxc vnc proxy UPID:esx2:0000340E:087D4219:5778E546:vncproxy:146:mir at pam:
Jul 3 12:13:26 esx2 pvedaemon[16432]: <mir at pam> starting task UPID:esx2:0000340E:087D4219:5778E546:vncproxy:146:mir at pam:
Jul 3 12:13:43 esx2 pmxcfs[1806]: [status] notice: received log
Jul 3 12:14:38 esx2 pvedaemon[16432]: <mir at pam> starting task UPID:esx2:0000353B:087D5DE9:5778E58E:spiceproxy:146:mir at pam:
Jul 3 12:14:38 esx2 pvedaemon[13627]: starting spiceterm UPID:esx2:0000353B:087D5DE9:5778E58E:spiceproxy:146:mir at pam: - CT 146
Jul 3 12:14:38 esx2 pvedaemon[13627]: launch command: /usr/bin/spiceterm --port 61009 --addr 127.0.0.1 --timeout 40 --authpath /vms/146 --permissions VM.Console --keymap da -- /usr/bin/dtach -A /var/run/dtach/vzctlconsole146 -r winch -z lxc-console -n 146
Jul 3 12:14:54 esx2 pvedaemon[16563]: <mir at pam> starting task UPID:esx2:00003598:087D6436:5778E59E:vzshutdown:146:mir at pam:
Jul 3 12:14:54 esx2 pvedaemon[13720]: shutdown CT 146: UPID:esx2:00003598:087D6436:5778E59E:vzshutdown:146:mir at pam:
Jul 3 12:15:41 esx2 kernel: [1424436.554919] INFO: task loop0:12858 blocked for more than 120 seconds.
Jul 3 12:15:41 esx2 kernel: [1424436.554977] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:15:41 esx2 kernel: [1424436.555026] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:15:41 esx2 kernel: [1424436.555107] loop0 D ffff88020d237a48 0 12858 2 0x00000000
Jul 3 12:15:41 esx2 kernel: [1424436.555191] ffff88020d237a48 ffffffffc0578500 ffff88040d6b8dc0 ffff88014cc7e040
Jul 3 12:15:41 esx2 kernel: [1424436.555280] ffff88020d238000 ffff88041fc57180 7fffffffffffffff ffffffff81845a70
Jul 3 12:15:41 esx2 kernel: [1424436.555367] ffff88020d237ba8 ffff88020d237a60 ffffffff81845185 0000000000000000
Jul 3 12:15:41 esx2 kernel: [1424436.555456] Call Trace:
Jul 3 12:15:41 esx2 kernel: [1424436.555501] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.555550] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:15:41 esx2 kernel: [1424436.555597] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:15:41 esx2 kernel: [1424436.555648] [<ffffffff810f57dc>] ? ktime_get+0x3c/0xb0
Jul 3 12:15:41 esx2 kernel: [1424436.555695] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.555759] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:15:41 esx2 kernel: [1424436.555809] [<ffffffff81845a8b>] bit_wait_io+0x1b/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.555856] [<ffffffff8184553f>] __wait_on_bit+0x5f/0x90
Jul 3 12:15:41 esx2 kernel: [1424436.555906] [<ffffffff8118c96d>] wait_on_page_bit+0xcd/0xf0
Jul 3 12:15:41 esx2 kernel: [1424436.555955] [<ffffffff810c3f10>] ? autoremove_wake_function+0x40/0x40
Jul 3 12:15:41 esx2 kernel: [1424436.556007] [<ffffffff8118ca7e>] __filemap_fdatawait_range+0xee/0x170
Jul 3 12:15:41 esx2 kernel: [1424436.556059] [<ffffffff8118cb14>] filemap_fdatawait_range+0x14/0x30
Jul 3 12:15:41 esx2 kernel: [1424436.556109] [<ffffffff8118e9af>] filemap_write_and_wait_range+0x3f/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.556173] [<ffffffffc055f193>] nfs_file_fsync+0x83/0x130 [nfs]
Jul 3 12:15:41 esx2 kernel: [1424436.556224] [<ffffffff81240dcd>] vfs_fsync_range+0x3d/0xb0
Jul 3 12:15:41 esx2 kernel: [1424436.556272] [<ffffffff81240e5c>] vfs_fsync+0x1c/0x20
Jul 3 12:15:41 esx2 kernel: [1424436.556320] [<ffffffff81575852>] loop_queue_work+0x5c2/0x740
Jul 3 12:15:41 esx2 kernel: [1424436.556369] [<ffffffff810a1374>] kthread_worker_fn+0x64/0x190
Jul 3 12:15:41 esx2 kernel: [1424436.556418] [<ffffffff810a1310>] ? kthread_create_on_node+0x1e0/0x1e0
Jul 3 12:15:41 esx2 kernel: [1424436.556469] [<ffffffff810a0d5a>] kthread+0xea/0x100
Jul 3 12:15:41 esx2 kernel: [1424436.556515] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:15:41 esx2 kernel: [1424436.556564] [<ffffffff8184964f>] ret_from_fork+0x3f/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.556611] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:15:41 esx2 kernel: [1424436.556659] INFO: task kmmpd-loop0:12862 blocked for more than 120 seconds.
Jul 3 12:15:41 esx2 kernel: [1424436.556711] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:15:41 esx2 kernel: [1424436.556758] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:15:41 esx2 kernel: [1424436.556838] kmmpd-loop0 D ffff88035dc27c08 0 12862 2 0x00000000
Jul 3 12:15:41 esx2 kernel: [1424436.556920] ffff88035dc27c08 ffff88035dc27bf8 ffffffff81e12580 ffff880196c69b80
Jul 3 12:15:41 esx2 kernel: [1424436.557034] ffff88035dc28000 ffff88041fc17180 7fffffffffffffff ffffffff81845a70
Jul 3 12:15:41 esx2 kernel: [1424436.557122] ffff88035dc27d68 ffff88035dc27c20 ffffffff81845185 0000000000000000
Jul 3 12:15:41 esx2 kernel: [1424436.557210] Call Trace:
Jul 3 12:15:41 esx2 kernel: [1424436.557248] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.557297] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:15:41 esx2 kernel: [1424436.557344] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:15:41 esx2 kernel: [1424436.557394] [<ffffffff813c7cea>] ? blk_mq_run_hw_queue+0x8a/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.557444] [<ffffffff813c94e5>] ? blk_sq_make_request+0x1c5/0x3e0
Jul 3 12:15:41 esx2 kernel: [1424436.557494] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.557543] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:15:41 esx2 kernel: [1424436.557593] [<ffffffff81845a8b>] bit_wait_io+0x1b/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.557640] [<ffffffff8184553f>] __wait_on_bit+0x5f/0x90
Jul 3 12:15:41 esx2 kernel: [1424436.557688] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.557737] [<ffffffff818455f1>] out_of_line_wait_on_bit+0x81/0xb0
Jul 3 12:15:41 esx2 kernel: [1424436.557788] [<ffffffff810c3f10>] ? autoremove_wake_function+0x40/0x40
Jul 3 12:15:41 esx2 kernel: [1424436.557839] [<ffffffff81243b52>] __wait_on_buffer+0x32/0x40
Jul 3 12:15:41 esx2 kernel: [1424436.557893] [<ffffffff812da4a0>] write_mmp_block+0x110/0x160
Jul 3 12:15:41 esx2 kernel: [1424436.557943] [<ffffffff812da8f1>] kmmpd+0x1a1/0x400
Jul 3 12:15:41 esx2 kernel: [1424436.557989] [<ffffffff81844a71>] ? __schedule+0x371/0xa50
Jul 3 12:15:41 esx2 kernel: [1424436.558037] [<ffffffff812da750>] ? __dump_mmp_msg+0x70/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.558085] [<ffffffff810a0d5a>] kthread+0xea/0x100
Jul 3 12:15:41 esx2 kernel: [1424436.558131] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:15:41 esx2 kernel: [1424436.558206] [<ffffffff8184964f>] ret_from_fork+0x3f/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.558253] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:15:41 esx2 kernel: [1424436.558301] INFO: task jbd2/loop0-8:12863 blocked for more than 120 seconds.
Jul 3 12:15:41 esx2 kernel: [1424436.558378] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:15:41 esx2 kernel: [1424436.558425] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:15:41 esx2 kernel: [1424436.558505] jbd2/loop0-8 D ffff8803c44ffab8 0 12863 2 0x00000000
Jul 3 12:15:41 esx2 kernel: [1424436.558587] ffff8803c44ffab8 ffff8803c44ffa90 ffff88040d6ba940 ffff88040521c4c0
Jul 3 12:15:41 esx2 kernel: [1424436.558674] ffff8803c4500000 ffff88041fcd7180 7fffffffffffffff ffffffff81845a70
Jul 3 12:15:41 esx2 kernel: [1424436.558762] ffff8803c44ffc10 ffff8803c44ffad0 ffffffff81845185 0000000000000000
Jul 3 12:15:41 esx2 kernel: [1424436.558850] Call Trace:
Jul 3 12:15:41 esx2 kernel: [1424436.558904] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.558959] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:15:41 esx2 kernel: [1424436.559007] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:15:41 esx2 kernel: [1424436.559061] [<ffffffff810f57dc>] ? ktime_get+0x3c/0xb0
Jul 3 12:15:41 esx2 kernel: [1424436.559109] [<ffffffff810f57dc>] ? ktime_get+0x3c/0xb0
Jul 3 12:15:41 esx2 kernel: [1424436.559158] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.559209] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:15:41 esx2 kernel: [1424436.559260] [<ffffffff81845a8b>] bit_wait_io+0x1b/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.559309] [<ffffffff8184553f>] __wait_on_bit+0x5f/0x90
Jul 3 12:15:41 esx2 kernel: [1424436.559358] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:15:41 esx2 kernel: [1424436.559435] [<ffffffff818455f1>] out_of_line_wait_on_bit+0x81/0xb0
Jul 3 12:15:41 esx2 kernel: [1424436.559487] [<ffffffff810c3f10>] ? autoremove_wake_function+0x40/0x40
Jul 3 12:15:41 esx2 kernel: [1424436.559539] [<ffffffff81243b52>] __wait_on_buffer+0x32/0x40
Jul 3 12:15:41 esx2 kernel: [1424436.559590] [<ffffffff812edd28>] jbd2_journal_commit_transaction+0x1118/0x18f0
Jul 3 12:15:41 esx2 kernel: [1424436.563492] [<ffffffff8102d736>] ? __switch_to+0x256/0x5c0
Jul 3 12:15:41 esx2 kernel: [1424436.563541] [<ffffffff812f1fb5>] kjournald2+0xe5/0x280
Jul 3 12:15:41 esx2 kernel: [1424436.563589] [<ffffffff810c3ed0>] ? wait_woken+0x90/0x90
Jul 3 12:15:41 esx2 kernel: [1424436.563636] [<ffffffff812f1ed0>] ? commit_timeout+0x10/0x10
Jul 3 12:15:41 esx2 kernel: [1424436.563684] [<ffffffff810a0d5a>] kthread+0xea/0x100
Jul 3 12:15:41 esx2 kernel: [1424436.563730] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:15:41 esx2 kernel: [1424436.563779] [<ffffffff8184964f>] ret_from_fork+0x3f/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.563826] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:15:41 esx2 kernel: [1424436.563875] INFO: task systemd-journal:13104 blocked for more than 120 seconds.
Jul 3 12:15:41 esx2 kernel: [1424436.563953] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:15:41 esx2 kernel: [1424436.564001] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:15:41 esx2 kernel: [1424436.564081] systemd-journal D ffff88018c5dbdd8 0 13104 12907 0x00000100
Jul 3 12:15:41 esx2 kernel: [1424436.564163] ffff88018c5dbdd8 0000000000000246 ffff88040521c4c0 ffff8804096c8000
Jul 3 12:15:41 esx2 kernel: [1424436.564251] ffff88018c5dc000 0000000000000083 ffff88040c5dd088 ffff88040c5dd024
Jul 3 12:15:41 esx2 kernel: [1424436.564365] ffff88018c5dbe20 ffff88018c5dbdf0 ffffffff81845185 ffff88040c5dd000
Jul 3 12:15:41 esx2 kernel: [1424436.564452] Call Trace:
Jul 3 12:15:41 esx2 kernel: [1424436.564494] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:15:41 esx2 kernel: [1424436.564540] [<ffffffff812f1ad9>] jbd2_log_wait_commit+0xa9/0x130
Jul 3 12:15:41 esx2 kernel: [1424436.564590] [<ffffffff810c3ed0>] ? wait_woken+0x90/0x90
Jul 3 12:15:41 esx2 kernel: [1424436.564638] [<ffffffff812f4717>] jbd2_complete_transaction+0x57/0x90
Jul 3 12:15:41 esx2 kernel: [1424436.564690] [<ffffffff81294f6b>] ext4_sync_file+0x28b/0x320
Jul 3 12:15:41 esx2 kernel: [1424436.564738] [<ffffffff81240dcd>] vfs_fsync_range+0x3d/0xb0
Jul 3 12:15:41 esx2 kernel: [1424436.564787] [<ffffffff81003885>] ? syscall_trace_enter_phase1+0xc5/0x140
Jul 3 12:15:41 esx2 kernel: [1424436.564840] [<ffffffff81240e9d>] do_fsync+0x3d/0x70
Jul 3 12:15:41 esx2 kernel: [1424436.564887] [<ffffffff81241130>] SyS_fsync+0x10/0x20
Jul 3 12:15:41 esx2 kernel: [1424436.564935] [<ffffffff818492b6>] entry_SYSCALL_64_fastpath+0x16/0x75
Jul 3 12:15:41 esx2 kernel: [1424436.564987] INFO: task vgs:13312 blocked for more than 120 seconds.
Jul 3 12:15:41 esx2 kernel: [1424436.565038] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:15:41 esx2 kernel: [1424436.565085] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:15:41 esx2 kernel: [1424436.565166] vgs D ffff8800838779f8 0 13312 1931 0x00000000
Jul 3 12:15:41 esx2 kernel: [1424436.565248] ffff8800838779f8 0000000000000000 ffffffff81e12580 ffff8801f379a940
Jul 3 12:15:41 esx2 kernel: [1424436.565336] ffff880083878000 ffff88041fc17180 7fffffffffffffff ffff8801f379a940
Jul 3 12:15:41 esx2 kernel: [1424436.565424] ffff880408d79180 ffff880083877a10 ffffffff81845185 0000000000000000
Jul 3 12:15:41 esx2 kernel: [1424436.565513] Call Trace:
Jul 3 12:15:41 esx2 kernel: [1424436.565565] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:15:41 esx2 kernel: [1424436.565612] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:15:41 esx2 kernel: [1424436.565661] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:15:41 esx2 kernel: [1424436.565712] [<ffffffff8124cbcc>] do_blockdev_direct_IO+0x1b1c/0x2be0
Jul 3 12:15:41 esx2 kernel: [1424436.565764] [<ffffffff8119c7b1>] ? pagevec_lookup_tag+0x21/0x30
Jul 3 12:15:41 esx2 kernel: [1424436.565814] [<ffffffff81247a50>] ? I_BDEV+0x20/0x20
Jul 3 12:15:41 esx2 kernel: [1424436.565862] [<ffffffff8124dcd3>] __blockdev_direct_IO+0x43/0x50
Jul 3 12:15:41 esx2 kernel: [1424436.565912] [<ffffffff81248128>] blkdev_direct_IO+0x58/0x80
Jul 3 12:15:41 esx2 kernel: [1424436.565962] [<ffffffff8118ee4f>] generic_file_read_iter+0x46f/0x5c0
Jul 3 12:15:41 esx2 kernel: [1424436.566014] [<ffffffff812484f7>] blkdev_read_iter+0x37/0x40
Jul 3 12:15:41 esx2 kernel: [1424436.566064] [<ffffffff8120c3d4>] new_sync_read+0x94/0xd0
Jul 3 12:15:41 esx2 kernel: [1424436.566113] [<ffffffff8120c436>] __vfs_read+0x26/0x40
Jul 3 12:15:41 esx2 kernel: [1424436.566160] [<ffffffff8120ca76>] vfs_read+0x86/0x130
Jul 3 12:15:41 esx2 kernel: [1424436.566208] [<ffffffff8120d8e5>] SyS_read+0x55/0xc0
Jul 3 12:15:41 esx2 kernel: [1424436.566256] [<ffffffff818492b6>] entry_SYSCALL_64_fastpath+0x16/0x75
Jul 3 12:16:04 esx2 pvedaemon[13720]: command 'lxc-wait -n 146 -t 5 -s STOPPED' failed: exit code 1
Jul 3 12:16:35 esx2 pmxcfs[1806]: [status] notice: received log
Jul 3 12:16:40 esx2 pmxcfs[1806]: [status] notice: received log
Jul 3 12:17:01 esx2 CRON[14244]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Jul 3 12:17:41 esx2 kernel: [1424556.565873] INFO: task loop0:12858 blocked for more than 120 seconds.
Jul 3 12:17:41 esx2 kernel: [1424556.565928] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:17:41 esx2 kernel: [1424556.565976] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:17:41 esx2 kernel: [1424556.566057] loop0 D ffff88020d237a48 0 12858 2 0x00000000
Jul 3 12:17:41 esx2 kernel: [1424556.566140] ffff88020d237a48 ffffffffc0578500 ffff88040d6b8dc0 ffff88014cc7e040
Jul 3 12:17:41 esx2 kernel: [1424556.566228] ffff88020d238000 ffff88041fc57180 7fffffffffffffff ffffffff81845a70
Jul 3 12:17:41 esx2 kernel: [1424556.566316] ffff88020d237ba8 ffff88020d237a60 ffffffff81845185 0000000000000000
Jul 3 12:17:41 esx2 kernel: [1424556.566404] Call Trace:
Jul 3 12:17:41 esx2 kernel: [1424556.566449] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.566499] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:17:41 esx2 kernel: [1424556.566546] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:17:41 esx2 kernel: [1424556.566596] [<ffffffff810f57dc>] ? ktime_get+0x3c/0xb0
Jul 3 12:17:41 esx2 kernel: [1424556.566644] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.566693] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:17:41 esx2 kernel: [1424556.566780] [<ffffffff81845a8b>] bit_wait_io+0x1b/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.566845] [<ffffffff8184553f>] __wait_on_bit+0x5f/0x90
Jul 3 12:17:41 esx2 kernel: [1424556.566894] [<ffffffff8118c96d>] wait_on_page_bit+0xcd/0xf0
Jul 3 12:17:41 esx2 kernel: [1424556.566944] [<ffffffff810c3f10>] ? autoremove_wake_function+0x40/0x40
Jul 3 12:17:41 esx2 kernel: [1424556.566996] [<ffffffff8118ca7e>] __filemap_fdatawait_range+0xee/0x170
Jul 3 12:17:41 esx2 kernel: [1424556.567048] [<ffffffff8118cb14>] filemap_fdatawait_range+0x14/0x30
Jul 3 12:17:41 esx2 kernel: [1424556.567099] [<ffffffff8118e9af>] filemap_write_and_wait_range+0x3f/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.567164] [<ffffffffc055f193>] nfs_file_fsync+0x83/0x130 [nfs]
Jul 3 12:17:41 esx2 kernel: [1424556.567215] [<ffffffff81240dcd>] vfs_fsync_range+0x3d/0xb0
Jul 3 12:17:41 esx2 kernel: [1424556.567263] [<ffffffff81240e5c>] vfs_fsync+0x1c/0x20
Jul 3 12:17:41 esx2 kernel: [1424556.567311] [<ffffffff81575852>] loop_queue_work+0x5c2/0x740
Jul 3 12:17:41 esx2 kernel: [1424556.567360] [<ffffffff810a1374>] kthread_worker_fn+0x64/0x190
Jul 3 12:17:41 esx2 kernel: [1424556.567409] [<ffffffff810a1310>] ? kthread_create_on_node+0x1e0/0x1e0
Jul 3 12:17:41 esx2 kernel: [1424556.567460] [<ffffffff810a0d5a>] kthread+0xea/0x100
Jul 3 12:17:41 esx2 kernel: [1424556.567508] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:17:41 esx2 kernel: [1424556.567557] [<ffffffff8184964f>] ret_from_fork+0x3f/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.567605] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:17:41 esx2 kernel: [1424556.567653] INFO: task kmmpd-loop0:12862 blocked for more than 120 seconds.
Jul 3 12:17:41 esx2 kernel: [1424556.567706] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:17:41 esx2 kernel: [1424556.567753] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:17:41 esx2 kernel: [1424556.567833] kmmpd-loop0 D ffff88035dc27c08 0 12862 2 0x00000000
Jul 3 12:17:41 esx2 kernel: [1424556.567914] ffff88035dc27c08 ffff88035dc27bf8 ffffffff81e12580 ffff880196c69b80
Jul 3 12:17:41 esx2 kernel: [1424556.568002] ffff88035dc28000 ffff88041fc17180 7fffffffffffffff ffffffff81845a70
Jul 3 12:17:41 esx2 kernel: [1424556.568114] ffff88035dc27d68 ffff88035dc27c20 ffffffff81845185 0000000000000000
Jul 3 12:17:41 esx2 kernel: [1424556.568202] Call Trace:
Jul 3 12:17:41 esx2 kernel: [1424556.568241] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.568290] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:17:41 esx2 kernel: [1424556.568336] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:17:41 esx2 kernel: [1424556.568386] [<ffffffff813c7cea>] ? blk_mq_run_hw_queue+0x8a/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.568436] [<ffffffff813c94e5>] ? blk_sq_make_request+0x1c5/0x3e0
Jul 3 12:17:41 esx2 kernel: [1424556.568487] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.568536] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:17:41 esx2 kernel: [1424556.568586] [<ffffffff81845a8b>] bit_wait_io+0x1b/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.568633] [<ffffffff8184553f>] __wait_on_bit+0x5f/0x90
Jul 3 12:17:41 esx2 kernel: [1424556.568680] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.568730] [<ffffffff818455f1>] out_of_line_wait_on_bit+0x81/0xb0
Jul 3 12:17:41 esx2 kernel: [1424556.568780] [<ffffffff810c3f10>] ? autoremove_wake_function+0x40/0x40
Jul 3 12:17:41 esx2 kernel: [1424556.568834] [<ffffffff81243b52>] __wait_on_buffer+0x32/0x40
Jul 3 12:17:41 esx2 kernel: [1424556.568884] [<ffffffff812da4a0>] write_mmp_block+0x110/0x160
Jul 3 12:17:41 esx2 kernel: [1424556.568934] [<ffffffff812da8f1>] kmmpd+0x1a1/0x400
Jul 3 12:17:41 esx2 kernel: [1424556.568980] [<ffffffff81844a71>] ? __schedule+0x371/0xa50
Jul 3 12:17:41 esx2 kernel: [1424556.569030] [<ffffffff812da750>] ? __dump_mmp_msg+0x70/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.569079] [<ffffffff810a0d5a>] kthread+0xea/0x100
Jul 3 12:17:41 esx2 kernel: [1424556.569126] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:17:41 esx2 kernel: [1424556.569175] [<ffffffff8184964f>] ret_from_fork+0x3f/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.569223] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:17:41 esx2 kernel: [1424556.569285] INFO: task jbd2/loop0-8:12863 blocked for more than 120 seconds.
Jul 3 12:17:41 esx2 kernel: [1424556.569363] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:17:41 esx2 kernel: [1424556.569410] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:17:41 esx2 kernel: [1424556.569490] jbd2/loop0-8 D ffff8803c44ffab8 0 12863 2 0x00000000
Jul 3 12:17:41 esx2 kernel: [1424556.569572] ffff8803c44ffab8 ffff8803c44ffa90 ffff88040d6ba940 ffff88040521c4c0
Jul 3 12:17:41 esx2 kernel: [1424556.569659] ffff8803c4500000 ffff88041fcd7180 7fffffffffffffff ffffffff81845a70
Jul 3 12:17:41 esx2 kernel: [1424556.569747] ffff8803c44ffc10 ffff8803c44ffad0 ffffffff81845185 0000000000000000
Jul 3 12:17:41 esx2 kernel: [1424556.569850] Call Trace:
Jul 3 12:17:41 esx2 kernel: [1424556.569893] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.569945] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:17:41 esx2 kernel: [1424556.569992] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:17:41 esx2 kernel: [1424556.570046] [<ffffffff810f57dc>] ? ktime_get+0x3c/0xb0
Jul 3 12:17:41 esx2 kernel: [1424556.570095] [<ffffffff810f57dc>] ? ktime_get+0x3c/0xb0
Jul 3 12:17:41 esx2 kernel: [1424556.570144] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.570193] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:17:41 esx2 kernel: [1424556.570243] [<ffffffff81845a8b>] bit_wait_io+0x1b/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.570291] [<ffffffff8184553f>] __wait_on_bit+0x5f/0x90
Jul 3 12:17:41 esx2 kernel: [1424556.570339] [<ffffffff81845a70>] ? bit_wait_timeout+0xa0/0xa0
Jul 3 12:17:41 esx2 kernel: [1424556.570390] [<ffffffff818455f1>] out_of_line_wait_on_bit+0x81/0xb0
Jul 3 12:17:41 esx2 kernel: [1424556.570442] [<ffffffff810c3f10>] ? autoremove_wake_function+0x40/0x40
Jul 3 12:17:41 esx2 kernel: [1424556.570509] [<ffffffff81243b52>] __wait_on_buffer+0x32/0x40
Jul 3 12:17:41 esx2 kernel: [1424556.570560] [<ffffffff812edd28>] jbd2_journal_commit_transaction+0x1118/0x18f0
Jul 3 12:17:41 esx2 kernel: [1424556.570642] [<ffffffff8102d736>] ? __switch_to+0x256/0x5c0
Jul 3 12:17:41 esx2 kernel: [1424556.570692] [<ffffffff812f1fb5>] kjournald2+0xe5/0x280
Jul 3 12:17:41 esx2 kernel: [1424556.570740] [<ffffffff810c3ed0>] ? wait_woken+0x90/0x90
Jul 3 12:17:41 esx2 kernel: [1424556.570789] [<ffffffff812f1ed0>] ? commit_timeout+0x10/0x10
Jul 3 12:17:41 esx2 kernel: [1424556.570838] [<ffffffff810a0d5a>] kthread+0xea/0x100
Jul 3 12:17:41 esx2 kernel: [1424556.570886] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:17:41 esx2 kernel: [1424556.570934] [<ffffffff8184964f>] ret_from_fork+0x3f/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.570983] [<ffffffff810a0c70>] ? kthread_park+0x60/0x60
Jul 3 12:17:41 esx2 kernel: [1424556.571032] INFO: task systemd-journal:13104 blocked for more than 120 seconds.
Jul 3 12:17:41 esx2 kernel: [1424556.571111] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:17:41 esx2 kernel: [1424556.571159] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:17:41 esx2 kernel: [1424556.571240] systemd-journal D ffff88018c5dbdd8 0 13104 12907 0x00000100
Jul 3 12:17:41 esx2 kernel: [1424556.571322] ffff88018c5dbdd8 0000000000000246 ffff88040521c4c0 ffff8804096c8000
Jul 3 12:17:41 esx2 kernel: [1424556.571411] ffff88018c5dc000 0000000000000083 ffff88040c5dd088 ffff88040c5dd024
Jul 3 12:17:41 esx2 kernel: [1424556.571499] ffff88018c5dbe20 ffff88018c5dbdf0 ffffffff81845185 ffff88040c5dd000
Jul 3 12:17:41 esx2 kernel: [1424556.575406] Call Trace:
Jul 3 12:17:41 esx2 kernel: [1424556.575445] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:17:41 esx2 kernel: [1424556.575492] [<ffffffff812f1ad9>] jbd2_log_wait_commit+0xa9/0x130
Jul 3 12:17:41 esx2 kernel: [1424556.575542] [<ffffffff810c3ed0>] ? wait_woken+0x90/0x90
Jul 3 12:17:41 esx2 kernel: [1424556.575590] [<ffffffff812f4717>] jbd2_complete_transaction+0x57/0x90
Jul 3 12:17:41 esx2 kernel: [1424556.575642] [<ffffffff81294f6b>] ext4_sync_file+0x28b/0x320
Jul 3 12:17:41 esx2 kernel: [1424556.575691] [<ffffffff81240dcd>] vfs_fsync_range+0x3d/0xb0
Jul 3 12:17:41 esx2 kernel: [1424556.575740] [<ffffffff81003885>] ? syscall_trace_enter_phase1+0xc5/0x140
Jul 3 12:17:41 esx2 kernel: [1424556.575792] [<ffffffff81240e9d>] do_fsync+0x3d/0x70
Jul 3 12:17:41 esx2 kernel: [1424556.575839] [<ffffffff81241130>] SyS_fsync+0x10/0x20
Jul 3 12:17:41 esx2 kernel: [1424556.575886] [<ffffffff818492b6>] entry_SYSCALL_64_fastpath+0x16/0x75
Jul 3 12:17:41 esx2 kernel: [1424556.575938] INFO: task vgs:13312 blocked for more than 120 seconds.
Jul 3 12:17:41 esx2 kernel: [1424556.575988] Tainted: G O 4.4.10-1-pve #1
Jul 3 12:17:41 esx2 kernel: [1424556.576035] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 3 12:17:41 esx2 kernel: [1424556.576115] vgs D ffff8800838779f8 0 13312 1931 0x00000000
Jul 3 12:17:41 esx2 kernel: [1424556.576197] ffff8800838779f8 0000000000000000 ffffffff81e12580 ffff8801f379a940
Jul 3 12:17:41 esx2 kernel: [1424556.576285] ffff880083878000 ffff88041fc17180 7fffffffffffffff ffff8801f379a940
Jul 3 12:17:41 esx2 kernel: [1424556.576373] ffff880408d79180 ffff880083877a10 ffffffff81845185 0000000000000000
Jul 3 12:17:41 esx2 kernel: [1424556.576461] Call Trace:
Jul 3 12:17:41 esx2 kernel: [1424556.576500] [<ffffffff81845185>] schedule+0x35/0x80
Jul 3 12:17:41 esx2 kernel: [1424556.576546] [<ffffffff818483c5>] schedule_timeout+0x235/0x2d0
Jul 3 12:17:41 esx2 kernel: [1424556.576622] [<ffffffff8184467b>] io_schedule_timeout+0xbb/0x140
Jul 3 12:17:41 esx2 kernel: [1424556.576672] [<ffffffff8124cbcc>] do_blockdev_direct_IO+0x1b1c/0x2be0
Jul 3 12:17:41 esx2 kernel: [1424556.576725] [<ffffffff8119c7b1>] ? pagevec_lookup_tag+0x21/0x30
Jul 3 12:17:41 esx2 kernel: [1424556.576779] [<ffffffff81247a50>] ? I_BDEV+0x20/0x20
Jul 3 12:17:41 esx2 kernel: [1424556.576826] [<ffffffff8124dcd3>] __blockdev_direct_IO+0x43/0x50
Jul 3 12:17:41 esx2 kernel: [1424556.576876] [<ffffffff81248128>] blkdev_direct_IO+0x58/0x80
Jul 3 12:17:41 esx2 kernel: [1424556.576925] [<ffffffff8118ee4f>] generic_file_read_iter+0x46f/0x5c0
Jul 3 12:17:41 esx2 kernel: [1424556.576977] [<ffffffff812484f7>] blkdev_read_iter+0x37/0x40
Jul 3 12:17:41 esx2 kernel: [1424556.577048] [<ffffffff8120c3d4>] new_sync_read+0x94/0xd0
Jul 3 12:17:41 esx2 kernel: [1424556.577097] [<ffffffff8120c436>] __vfs_read+0x26/0x40
Jul 3 12:17:41 esx2 kernel: [1424556.577144] [<ffffffff8120ca76>] vfs_read+0x86/0x130
Jul 3 12:17:41 esx2 kernel: [1424556.577192] [<ffffffff8120d8e5>] SyS_read+0x55/0xc0
Jul 3 12:17:41 esx2 kernel: [1424556.577239] [<ffffffff818492b6>] entry_SYSCALL_64_fastpath+0x16/0x75
--
Hilsen/Regards
Michael Rasmussen
Get my public GnuPG keys:
michael <at> rasmussen <dot> cc
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xD3C9A00E
mir <at> datanom <dot> net
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE501F51C
mir <at> miras <dot> org
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xE3E80917
--------------------------------------------------------------
/usr/games/fortune -es says:
If someone stinks, view it as a reason to help them, not a reason to
avoid them.
-- Larry Wall in <199702111730.JAA28598 at wall.org>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 181 bytes
Desc: OpenPGP digital signature
URL: <http://lists.proxmox.com/pipermail/pve-devel/attachments/20160704/70f0bb5f/attachment.sig>
More information about the pve-devel
mailing list