syzbot


INFO: task hung in gfs2_jhead_process_page

Status: upstream: reported C repro on 2022/12/21 02:23
Subsystems: mm (incorrect?)
Reported-by: syzbot+b9c5afe053a08cd29468@syzkaller.appspotmail.com
First crash: 119d, last: 2d08h

Cause bisection: failed (error log, bisect log)
similar bugs (2):
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 INFO: task hung in gfs2_jhead_process_page 1 4d03h 4d03h 0/3 upstream: reported on 2023/03/18 15:36
linux-5.15 INFO: task hung in gfs2_jhead_process_page 3 1h47m 12d 0/3 upstream: reported on 2023/03/10 07:53

Sample crash report:
INFO: task kworker/0:1:14 blocked for more than 143 seconds.
      Not tainted 6.1.0-syzkaller-14594-g72a85e2b0a1e #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/0:1     state:D stack:21408 pid:14    ppid:2      flags:0x00004000
Workqueue: gfs_recovery gfs2_recover_func
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5244 [inline]
 __schedule+0x995/0xe20 kernel/sched/core.c:6555
 schedule+0xcb/0x190 kernel/sched/core.c:6631
 io_schedule+0x83/0x100 kernel/sched/core.c:8811
 folio_wait_bit_common+0x83a/0x12a0 mm/filemap.c:1297
 folio_wait_locked include/linux/pagemap.h:1021 [inline]
 gfs2_jhead_process_page+0x195/0x800 fs/gfs2/lops.c:476
 gfs2_find_jhead+0xcef/0xea0 fs/gfs2/lops.c:594
 gfs2_recover_func+0x65b/0x1f30 fs/gfs2/recovery.c:460
 process_one_work+0x877/0xdb0 kernel/workqueue.c:2289
 worker_thread+0xb14/0x1330 kernel/workqueue.c:2436
 kthread+0x266/0x300 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task syz-executor253:5072 blocked for more than 143 seconds.
      Not tainted 6.1.0-syzkaller-14594-g72a85e2b0a1e #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:syz-executor253 state:D stack:20112 pid:5072  ppid:5071   flags:0x00004004
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5244 [inline]
 __schedule+0x995/0xe20 kernel/sched/core.c:6555
 schedule+0xcb/0x190 kernel/sched/core.c:6631
 bit_wait+0xe/0xc0 kernel/sched/wait_bit.c:199
 __wait_on_bit+0xb5/0x170 kernel/sched/wait_bit.c:49
 out_of_line_wait_on_bit+0x1c3/0x240 kernel/sched/wait_bit.c:64
 wait_on_bit include/linux/wait_bit.h:76 [inline]
 gfs2_recover_journal+0xda/0x120 fs/gfs2/recovery.c:577
 init_journal+0x18a5/0x22c0 fs/gfs2/ops_fstype.c:835
 init_inodes+0xdc/0x340 fs/gfs2/ops_fstype.c:889
 gfs2_fill_super+0x1bb2/0x2700 fs/gfs2/ops_fstype.c:1247
 get_tree_bdev+0x400/0x620 fs/super.c:1282
 gfs2_get_tree+0x50/0x210 fs/gfs2/ops_fstype.c:1330
 vfs_get_tree+0x88/0x270 fs/super.c:1489
 do_new_mount+0x289/0xad0 fs/namespace.c:3145
 do_mount fs/namespace.c:3488 [inline]
 __do_sys_mount fs/namespace.c:3697 [inline]
 __se_sys_mount+0x2d3/0x3c0 fs/namespace.c:3674
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3d/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f0b6c21691a
RSP: 002b:00007ffc89d65db8 EFLAGS: 00000282 ORIG_RAX: 00000000000000a5
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 00007f0b6c21691a
RDX: 0000000020021140 RSI: 0000000020021180 RDI: 00007ffc89d65dd0
RBP: 00007ffc89d65dd0 R08: 00007ffc89d65e10 R09: 0000000000000002
R10: 0000000000010010 R11: 0000000000000282 R12: 0000000000000004
R13: 0000555555b9b2c0 R14: 0000000000010010 R15: 00007ffc89d65e10
 </TASK>

Showing all locks held in the system:
1 lock held by rcu_tasks_kthre/12:
 #0: ffffffff8d326e90 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0xd00 kernel/rcu/tasks.h:507
1 lock held by rcu_tasks_trace/13:
 #0: ffffffff8d327690 (rcu_tasks_trace.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x30/0xd00 kernel/rcu/tasks.h:507
2 locks held by kworker/0:1/14:
 #0: ffff88801958e138 ((wq_completion)gfs_recovery){+.+.}-{0:0}, at: process_one_work+0x7f2/0xdb0
 #1: ffffc90000137d00 ((work_completion)(&jd->jd_work)){+.+.}-{0:0}, at: process_one_work+0x831/0xdb0 kernel/workqueue.c:2264
1 lock held by khungtaskd/28:
 #0: ffffffff8d326cc0 (rcu_read_lock){....}-{1:2}, at: rcu_lock_acquire+0x0/0x30
2 locks held by getty/4750:
 #0: ffff88802c55b098 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x21/0x70 drivers/tty/tty_ldisc.c:244
 #1: ffffc900015902f0 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0x53b/0x1650 drivers/tty/n_tty.c:2177
1 lock held by syz-executor253/5072:
 #0: ffff88802b1d40e0 (&type->s_umount_key#41/1){+.+.}-{3:3}, at: alloc_super+0x212/0x920 fs/super.c:228

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 28 Comm: khungtaskd Not tainted 6.1.0-syzkaller-14594-g72a85e2b0a1e #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
Call Trace:
 <TASK>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1b1/0x290 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x46f/0x4f0 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x1ba/0x420 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:148 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:220 [inline]
 watchdog+0xcd5/0xd20 kernel/hung_task.c:377
 kthread+0x266/0x300 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 2847 Comm: kworker/u4:6 Not tainted 6.1.0-syzkaller-14594-g72a85e2b0a1e #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:native_write_cr3 arch/x86/include/asm/special_insns.h:54 [inline]
RIP: 0010:write_cr3 arch/x86/include/asm/special_insns.h:174 [inline]
RIP: 0010:load_new_mm_cr3 arch/x86/mm/tlb.c:293 [inline]
RIP: 0010:switch_mm_irqs_off+0x51e/0x9c0 arch/x86/mm/tlb.c:628
Code: e8 a7 f3 ff ff 41 0f b7 cd 81 f9 ff 0f 00 00 48 8d 9c 24 90 00 00 00 0f 83 c4 01 00 00 41 ff c5 41 0f b7 cd 48 09 c8 0f 22 d8 <48> c7 c6 ff ff ff ff 4c 8b 6c 24 20 e9 c0 00 00 00 49 8d 9f 80 00
RSP: 0018:ffffc9000b5c7740 EFLAGS: 00000093
RAX: 000000000d08e000 RBX: ffffc9000b5c77d0 RCX: ffff888028c91d40
RDX: 0000000000000000 RSI: 000000000d08e000 RDI: 000000001fffffff
RBP: ffffc9000b5c7830 R08: ffffffff813e283c R09: fffffbfff1a80adf
R10: fffffbfff1a80adf R11: 1ffffffff1a80ade R12: dffffc0000000000
R13: 0000000000000000 R14: ffffffff8d405140 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff8880b9900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb907dfc990 CR3: 000000000d08e000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <TASK>
 unuse_temporary_mm arch/x86/kernel/alternative.c:1518 [inline]
 __text_poke+0x69e/0x900 arch/x86/kernel/alternative.c:1628
 text_poke arch/x86/kernel/alternative.c:1671 [inline]
 text_poke_bp_batch+0x64c/0x850 arch/x86/kernel/alternative.c:2027
 text_poke_flush arch/x86/kernel/alternative.c:2131 [inline]
 text_poke_finish+0x16/0x30 arch/x86/kernel/alternative.c:2138
 arch_jump_label_transform_apply+0x13/0x20 arch/x86/kernel/jump_label.c:146
 static_key_disable_cpuslocked+0xc8/0x1b0 kernel/jump_label.c:235
 static_key_disable+0x16/0x20 kernel/jump_label.c:243
 toggle_allocation_gate+0x1a8/0x240 mm/kfence/core.c:804
 process_one_work+0x877/0xdb0 kernel/workqueue.c:2289
 worker_thread+0xb14/0x1330 kernel/workqueue.c:2436
 kthread+0x266/0x300 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>

Crashes (103):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets Title
ci2-upstream-fs 2022/12/24 21:45 upstream 72a85e2b0a1e 9da18ae8 .config strace log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] INFO: task hung in gfs2_jhead_process_page
ci-upstream-linux-next-kasan-gce-root 2023/03/03 17:20 linux-next 1acf39ef8f14 f8902b57 .config strace log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2022/12/24 04:02 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci a5541c0811a0 9da18ae8 .config console log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-smack-root 2023/03/20 10:32 upstream e8d018dd0257 7939252e .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/03/18 00:36 upstream 38e04b3e4240 7939252e .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/03/12 17:30 upstream 134231664868 5205ef30 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-selinux-root 2023/03/03 10:52 upstream 2eb29d59ddf0 f8902b57 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-smack-root 2023/03/01 12:17 upstream c0927a7a5391 f8902b57 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/02/23 14:47 upstream 307e14c03906 9e2ebb3c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/02/20 02:01 upstream 925cf0457d7e bcdf85f8 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/02/18 15:30 upstream 38f8ccde04a3 d02e9a70 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/02/18 11:40 upstream 38f8ccde04a3 d02e9a70 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/02/08 08:56 upstream 513c1a3d3f19 15c3d445 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-selinux-root 2023/02/05 21:08 upstream 837c07cf68fe be607b78 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/02/01 01:54 upstream 22b8077d0fce b68fb8d6 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-root 2023/01/30 14:58 upstream 6d796c50f84c 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-smack-root 2023/01/28 08:58 upstream 83abd4d4c4be 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/28 04:21 upstream 83abd4d4c4be 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/26 12:48 upstream 7c46948a6e9c 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/26 08:40 upstream 7c46948a6e9c 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-selinux-root 2023/01/25 03:47 upstream fb6e71db53f3 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/16 15:21 upstream 5dc4c995db9e a63719e7 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/15 02:01 upstream 97ec4d559d93 a63719e7 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/14 20:37 upstream 97ec4d559d93 a63719e7 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/14 05:56 upstream d9fc1511728c 529798b0 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/12 02:55 upstream 7dd4b804e080 96166539 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/11 22:18 upstream 7dd4b804e080 96166539 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/11 00:39 upstream 5a41237ad1d4 48bc529a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-root 2023/01/10 04:03 upstream 5a41237ad1d4 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/09 22:47 upstream 1fe4fd6f5cad 48bc529a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-root 2023/01/08 23:20 upstream e9ffbf16caa6 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/05 20:39 upstream 512dee0c00ad 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/05 01:04 upstream 69b41ac87e4a 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2023/01/02 22:59 upstream 88603b6dc419 ab32d508 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-selinux-root 2023/01/02 01:12 upstream 150aae354b81 ab32d508 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-smack-root 2022/12/20 22:53 upstream 6feb57c2fd7c d3e76707 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2022/12/17 02:10 upstream 84e57d292203 05494336 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci2-upstream-fs 2022/12/13 23:35 upstream 02bf43c7b7f7 f6511626 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-kasan-gce-root 2022/11/22 23:23 upstream eb7081409f94 9da37ae8 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/03/05 13:01 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 596b6b709632 f8902b57 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/02/27 12:28 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 2ebd1fbb946d e792ae78 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/02/05 15:49 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci ca72d58361ee be607b78 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/02/03 06:38 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci ca72d58361ee 16d19e30 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/31 10:08 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci c62c88e05937 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/30 19:41 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci c62c88e05937 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/26 20:09 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 1dc22be1f91f 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/20 10:40 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 9598c377d828 559a440a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/19 09:12 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 9598c377d828 42660d9e .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/16 18:03 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 9598c377d828 a63719e7 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/14 02:59 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 9598c377d828 529798b0 .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/11 15:48 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 358a161a6a9e 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/11 06:19 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 358a161a6a9e 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/09 09:46 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci ae87308093bc 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/08 15:13 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci ae87308093bc 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
ci-upstream-gce-arm64 2023/01/06 14:40 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 247f34f7b803 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] INFO: task hung in gfs2_jhead_process_page
* Struck through repros no longer work on HEAD.