INFO: task khugepaged:1088 blocked for more than 143 seconds. Not tainted 5.4.0-rc4-next-20191025 #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. khugepaged D27848 1088 2 0x80004000 Call Trace: context_switch kernel/sched/core.c:3385 [inline] __schedule+0x94a/0x1e70 kernel/sched/core.c:4070 schedule+0xdc/0x2b0 kernel/sched/core.c:4144 io_schedule+0x1c/0x70 kernel/sched/core.c:5788 wait_on_page_bit_common mm/filemap.c:1175 [inline] __lock_page+0x422/0xab0 mm/filemap.c:1383 lock_page include/linux/pagemap.h:480 [inline] mpage_prepare_extent_to_map+0xb3f/0xf90 fs/ext4/inode.c:2668 ext4_writepages+0xb6a/0x2e70 fs/ext4/inode.c:2866 ? 0xffffffff81000000 do_writepages+0xfa/0x2a0 mm/page-writeback.c:2344 __filemap_fdatawrite_range+0x2bc/0x3b0 mm/filemap.c:421 __filemap_fdatawrite mm/filemap.c:429 [inline] filemap_flush+0x24/0x30 mm/filemap.c:456 collapse_file+0x36b1/0x41a0 mm/khugepaged.c:1652 khugepaged_scan_file mm/khugepaged.c:1890 [inline] khugepaged_scan_mm_slot mm/khugepaged.c:1988 [inline] khugepaged_do_scan mm/khugepaged.c:2072 [inline] khugepaged+0x2da9/0x4360 mm/khugepaged.c:2117 kthread+0x361/0x430 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 Showing all locks held in the system: 4 locks held by kworker/u4:1/21: #0: ffff8880a821bd28 ((wq_completion)writeback){+.+.}, at: __write_once_size include/linux/compiler.h:226 [inline] #0: ffff8880a821bd28 ((wq_completion)writeback){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: ffff8880a821bd28 ((wq_completion)writeback){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: ffff8880a821bd28 ((wq_completion)writeback){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: ffff8880a821bd28 ((wq_completion)writeback){+.+.}, at: set_work_data kernel/workqueue.c:620 [inline] #0: ffff8880a821bd28 ((wq_completion)writeback){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:647 [inline] #0: ffff8880a821bd28 ((wq_completion)writeback){+.+.}, at: process_one_work+0x88b/0x1740 kernel/workqueue.c:2240 #1: ffff8880a9a07dc0 ((work_completion)(&(&wb->dwork)->work)){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244 #2: ffff88809b5100d8 (&type->s_umount_key#32){++++}, at: trylock_super+0x22/0x110 fs/super.c:418 #3: ffff88809b512990 (&sbi->s_journal_flag_rwsem){.+.+}, at: do_writepages+0xfa/0x2a0 mm/page-writeback.c:2344 1 lock held by khungtaskd/1080: #0: ffffffff88faba80 (rcu_read_lock){....}, at: debug_show_all_locks+0x5f/0x279 kernel/locking/lockdep.c:5336 1 lock held by khugepaged/1088: #0: ffff88809b512990 (&sbi->s_journal_flag_rwsem){.+.+}, at: do_writepages+0xfa/0x2a0 mm/page-writeback.c:2344 3 locks held by udevd/3922: 1 lock held by rsyslogd/8661: #0: ffff8880a09cde20 (&f->f_pos_lock){+.+.}, at: __fdget_pos+0xee/0x110 fs/file.c:801 2 locks held by getty/8751: #0: ffff88809b427090 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f192e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x220/0x1bf0 drivers/tty/n_tty.c:2156 2 locks held by getty/8752: #0: ffff8880a789b090 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f292e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x220/0x1bf0 drivers/tty/n_tty.c:2156 2 locks held by getty/8753: #0: ffff8880a932f090 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f092e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x220/0x1bf0 drivers/tty/n_tty.c:2156 2 locks held by getty/8754: #0: ffff888093644090 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f2d2e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x220/0x1bf0 drivers/tty/n_tty.c:2156 2 locks held by getty/8755: #0: ffff8880a22af090 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f152e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x220/0x1bf0 drivers/tty/n_tty.c:2156 2 locks held by getty/8756: #0: ffff8880a5a08090 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f312e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x220/0x1bf0 drivers/tty/n_tty.c:2156 2 locks held by getty/8757: #0: ffff88809b279090 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f012e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x220/0x1bf0 drivers/tty/n_tty.c:2156 3 locks held by syz-executor.2/8795: 1 lock held by syz-executor.5/8803: 2 locks held by syz-executor.2/22825: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 #1: ffffffff88faba80 (rcu_read_lock){....}, at: trace_sched_stat_runtime include/trace/events/sched.h:435 [inline] #1: ffffffff88faba80 (rcu_read_lock){....}, at: update_curr+0x2ea/0x8d0 kernel/sched/fair.c:860 2 locks held by syz-executor.3/22853: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 #1: ffffffff88faba80 (rcu_read_lock){....}, at: trace_sched_stat_runtime include/trace/events/sched.h:435 [inline] #1: ffffffff88faba80 (rcu_read_lock){....}, at: update_curr+0x2ea/0x8d0 kernel/sched/fair.c:860 1 lock held by syz-executor.3/22857: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 1 lock held by syz-executor.2/22885: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 1 lock held by syz-executor.3/22891: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 1 lock held by syz-executor.5/22905: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 2 locks held by syz-executor.4/22909: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 #1: ffffffff88faba80 (rcu_read_lock){....}, at: trace_sched_stat_runtime include/trace/events/sched.h:435 [inline] #1: ffffffff88faba80 (rcu_read_lock){....}, at: update_curr+0x2ea/0x8d0 kernel/sched/fair.c:860 1 lock held by syz-executor.4/22927: 2 locks held by syz-executor.1/22931: #0: ffff8880ae834d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae834d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 #1: ffffffff88faba80 (rcu_read_lock){....}, at: trace_sched_stat_runtime include/trace/events/sched.h:435 [inline] #1: ffffffff88faba80 (rcu_read_lock){....}, at: update_curr+0x2ea/0x8d0 kernel/sched/fair.c:860 1 lock held by syz-executor.3/22942: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 2 locks held by syz-executor.0/22957: 4 locks held by syz-executor.3/22959: #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #0: ffff8880ae934d58 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4018 #1: ffffffff88faba80 (rcu_read_lock){....}, at: trace_sched_stat_runtime include/trace/events/sched.h:435 [inline] #1: ffffffff88faba80 (rcu_read_lock){....}, at: update_curr+0x2ea/0x8d0 kernel/sched/fair.c:860 #2: ffffffff88faba80 (rcu_read_lock){....}, at: nfulnl_rcv_nl_event+0x3b/0x4a0 net/netfilter/nfnetlink_log.c:822 #3: ffffffff88faba80 (rcu_read_lock){....}, at: ip6_datagram_release_cb+0x9a/0x550 net/ipv6/datagram.c:130 ============================================= NMI backtrace for cpu 0 CPU: 0 PID: 1080 Comm: khungtaskd Not tainted 5.4.0-rc4-next-20191025 #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:77 [inline] dump_stack+0x172/0x1f0 lib/dump_stack.c:113 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline] check_hung_uninterruptible_tasks kernel/hung_task.c:269 [inline] watchdog+0xc8f/0x1350 kernel/hung_task.c:353 kthread+0x361/0x430 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 22997 Comm: syz-executor.3 Not tainted 5.4.0-rc4-next-20191025 #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 RIP: 0010:apic_timer_interrupt+0x0/0x20 arch/x86/entry/entry_64.S:829 Code: 31 ff fc e8 57 50 a0 f9 48 89 e7 e8 2a 93 a0 f9 e8 2e 50 a0 f9 e9 c5 f2 ff ff c3 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 <68> 13 ff ff ff e8 76 f1 ff ff e8 61 2e 00 00 e9 6b f2 ff ff 66 90 RSP: 0018:ffff88807eb97d38 EFLAGS: 00000046 RAX: 0000000000000007 RBX: ffff8880a7237000 RCX: ffffffff8189bff1 RDX: 00000000ffffffff RSI: ffff8880a7237000 RDI: ffff8880a72372d4 RBP: ffff88807eb97ed8 R08: ffff8880925d62c0 R09: ffffed1015059889 R10: ffff88807eb97d58 R11: ffff8880a82cc447 R12: ffff8880a82cc400 R13: ffff8880a7237152 R14: 1ffff1100fd72fba R15: ffff8880a82cc440 FS: 00007f4ade45d700(0000) GS:ffff8880ae900000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000000000075c000 CR3: 00000000a42e4000 CR4: 00000000001406e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: __se_sys_perf_event_open kernel/events/core.c:10896 [inline] __x64_sys_perf_event_open+0xbe/0x150 kernel/events/core.c:10896 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290 entry_SYSCALL_64_after_hwframe+0x49/0xbe RIP: 0033:0x459f39 Code: ad b6 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 7b b6 fb ff c3 66 2e 0f 1f 84 00 00 00 00 RSP: 002b:00007f4ade45cc78 EFLAGS: 00000246 ORIG_RAX: 000000000000012a RAX: ffffffffffffffda RBX: 0000000000000005 RCX: 0000000000459f39 RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 000000002001d000 RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000 R10: ffffffffffffffff R11: 0000000000000246 R12: 00007f4ade45d6d4 R13: 00000000004c71c4 R14: 00000000004dcad0 R15: 00000000ffffffff