syzbot


INFO: task hung in gfs2_gl_hash_clear

Status: upstream: reported on 2023/01/04 01:01
Subsystems: gfs2
[Documentation on labels]
Reported-by: syzbot+3513eb236e889b5bd6ce@syzkaller.appspotmail.com
First crash: 529d, last: 529d
Similar bugs (6)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: task hung in gfs2_gl_hash_clear gfs2 156 1319d 1324d 0/27 auto-closed as invalid on 2021/02/02 22:47
upstream INFO: task hung in gfs2_gl_hash_clear (2) gfs2 1 740d 738d 0/27 auto-closed as invalid on 2022/09/04 20:20
linux-5.15 INFO: task hung in gfs2_gl_hash_clear origin:lts-only C inconclusive 1228 1h49m 320d 0/3 upstream: reported C repro on 2023/08/01 02:35
linux-6.1 INFO: task hung in gfs2_gl_hash_clear missing-backport origin:lts-only C done 1512 2h12m 307d 0/3 upstream: reported C repro on 2023/08/13 12:57
upstream INFO: task can't die in gfs2_gl_hash_clear (2) gfs2 3 1150d 1245d 0/27 auto-closed as invalid on 2021/07/21 03:15
upstream INFO: task hung in gfs2_gl_hash_clear (3) gfs2 C error done 80 176d 564d 26/27 fixed on 2024/01/30 15:47

Sample crash report:
wlan1: Creating new IBSS network, BSSID 50:50:50:50:50:50
IPv6: ADDRCONF(NETDEV_CHANGE): wlan1: link becomes ready
ieee802154 phy0 wpan0: encryption failed: -22
ieee802154 phy1 wpan1: encryption failed: -22
INFO: task syz-executor.3:8119 blocked for more than 140 seconds.
      Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.3  D23384  8119      1 0x00000004
Call Trace:
 context_switch kernel/sched/core.c:2828 [inline]
 __schedule+0x887/0x2040 kernel/sched/core.c:3517
 schedule+0x8d/0x1b0 kernel/sched/core.c:3561
 schedule_timeout+0x92d/0xfe0 kernel/time/timer.c:1794
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common+0x29c/0x470 kernel/sched/completion.c:115
 flush_workqueue+0x40b/0x13e0 kernel/workqueue.c:2713
 gfs2_gl_hash_clear+0x98/0x250 fs/gfs2/glock.c:1639
 gfs2_put_super+0x2ee/0x510 fs/gfs2/super.c:936
 generic_shutdown_super+0x144/0x370 fs/super.c:456
 kill_block_super+0x97/0xf0 fs/super.c:1185
 gfs2_kill_sb+0x12c/0x1a0 fs/gfs2/ops_fstype.c:1390
 deactivate_locked_super+0x94/0x160 fs/super.c:329
 deactivate_super+0x174/0x1a0 fs/super.c:360
 cleanup_mnt+0x1a8/0x290 fs/namespace.c:1098
 task_work_run+0x148/0x1c0 kernel/task_work.c:113
 tracehook_notify_resume include/linux/tracehook.h:193 [inline]
 exit_to_usermode_loop+0x251/0x2a0 arch/x86/entry/common.c:167
 prepare_exit_to_usermode arch/x86/entry/common.c:198 [inline]
 syscall_return_slowpath arch/x86/entry/common.c:271 [inline]
 do_syscall_64+0x538/0x620 arch/x86/entry/common.c:296
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7ff11bb70517
Code: Bad RIP value.
RSP: 002b:00007fff9df038e8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007ff11bb70517
RDX: 00007fff9df039bc RSI: 000000000000000a RDI: 00007fff9df039b0
RBP: 00007fff9df039b0 R08: 00000000ffffffff R09: 00007fff9df03780
R10: 0000555556652903 R11: 0000000000000246 R12: 00007ff11bbc9b24
R13: 00007fff9df04a70 R14: 0000555556652810 R15: 00007fff9df04ab0
INFO: task syz-executor.4:21561 blocked for more than 140 seconds.
      Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.4  D26208 21561   8132 0x80000004
Call Trace:
 context_switch kernel/sched/core.c:2828 [inline]
 __schedule+0x887/0x2040 kernel/sched/core.c:3517
 schedule+0x8d/0x1b0 kernel/sched/core.c:3561
 io_schedule+0xb5/0x120 kernel/sched/core.c:5181
 bit_wait_io+0x12/0x90 kernel/sched/wait_bit.c:207
 __wait_on_bit+0x7e/0x150 kernel/sched/wait_bit.c:48
 out_of_line_wait_on_bit+0xd2/0x100 kernel/sched/wait_bit.c:63
 wait_on_bit_io include/linux/wait_bit.h:101 [inline]
 gfs2_evict_inode+0x816/0x14b0 fs/gfs2/super.c:1712
 evict+0x2ed/0x760 fs/inode.c:559
 iput_final fs/inode.c:1555 [inline]
 iput+0x4f1/0x860 fs/inode.c:1581
 gfs2_jindex_free+0x35c/0x500 fs/gfs2/super.c:322
 init_journal fs/gfs2/ops_fstype.c:765 [inline]
 init_inodes+0xcfc/0x1cf0 fs/gfs2/ops_fstype.c:783
 fill_super+0x18a6/0x2550 fs/gfs2/ops_fstype.c:1153
 gfs2_mount+0x4c0/0x5a0 fs/gfs2/ops_fstype.c:1316
 mount_fs+0xa3/0x310 fs/super.c:1261
 vfs_kern_mount.part.0+0x68/0x470 fs/namespace.c:961
 vfs_kern_mount fs/namespace.c:951 [inline]
 do_new_mount fs/namespace.c:2492 [inline]
 do_mount+0x115c/0x2f50 fs/namespace.c:2822
 ksys_mount+0xcf/0x130 fs/namespace.c:3038
 __do_sys_mount fs/namespace.c:3052 [inline]
 __se_sys_mount fs/namespace.c:3049 [inline]
 __x64_sys_mount+0xba/0x150 fs/namespace.c:3049
 do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7ff4a9df15da
Code: Bad RIP value.
RSP: 002b:00007ff4a8361f88 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
RAX: ffffffffffffffda RBX: 00000000000124d6 RCX: 00007ff4a9df15da
RDX: 00000000200124c0 RSI: 0000000020012500 RDI: 00007ff4a8361fe0
RBP: 00007ff4a8362020 R08: 00007ff4a8362020 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000202 R12: 00000000200124c0
R13: 0000000020012500 R14: 00007ff4a8361fe0 R15: 0000000020000040
INFO: task syz-executor.1:21586 blocked for more than 140 seconds.
      Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.1  D26120 21586   8134 0x80000004
Call Trace:
 context_switch kernel/sched/core.c:2828 [inline]
 __schedule+0x887/0x2040 kernel/sched/core.c:3517
 schedule+0x8d/0x1b0 kernel/sched/core.c:3561
 schedule_timeout+0x92d/0xfe0 kernel/time/timer.c:1794
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common+0x29c/0x470 kernel/sched/completion.c:115
 flush_workqueue+0x40b/0x13e0 kernel/workqueue.c:2713
 gfs2_gl_hash_clear+0x98/0x250 fs/gfs2/glock.c:1639
 fill_super+0x1edb/0x2550 fs/gfs2/ops_fstype.c:1205
 gfs2_mount+0x4c0/0x5a0 fs/gfs2/ops_fstype.c:1316
 mount_fs+0xa3/0x310 fs/super.c:1261
 vfs_kern_mount.part.0+0x68/0x470 fs/namespace.c:961
 vfs_kern_mount fs/namespace.c:951 [inline]
 do_new_mount fs/namespace.c:2492 [inline]
 do_mount+0x115c/0x2f50 fs/namespace.c:2822
 ksys_mount+0xcf/0x130 fs/namespace.c:3038
 __do_sys_mount fs/namespace.c:3052 [inline]
 __se_sys_mount fs/namespace.c:3049 [inline]
 __x64_sys_mount+0xba/0x150 fs/namespace.c:3049
 do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f35502ac5da
Code: Bad RIP value.
RSP: 002b:00007f354e81cf88 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
RAX: ffffffffffffffda RBX: 00000000000124d6 RCX: 00007f35502ac5da
RDX: 00000000200124c0 RSI: 0000000020012500 RDI: 00007f354e81cfe0
RBP: 00007f354e81d020 R08: 00007f354e81d020 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000202 R12: 00000000200124c0
R13: 0000000020012500 R14: 00007f354e81cfe0 R15: 0000000020000040
INFO: task syz-executor.5:21589 blocked for more than 140 seconds.
      Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.5  D26120 21589  12896 0x80000004
Call Trace:
 context_switch kernel/sched/core.c:2828 [inline]
 __schedule+0x887/0x2040 kernel/sched/core.c:3517
 schedule+0x8d/0x1b0 kernel/sched/core.c:3561
 schedule_timeout+0x92d/0xfe0 kernel/time/timer.c:1794
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common+0x29c/0x470 kernel/sched/completion.c:115
 flush_workqueue+0x40b/0x13e0 kernel/workqueue.c:2713
 gfs2_gl_hash_clear+0x98/0x250 fs/gfs2/glock.c:1639
 fill_super+0x1edb/0x2550 fs/gfs2/ops_fstype.c:1205
 gfs2_mount+0x4c0/0x5a0 fs/gfs2/ops_fstype.c:1316
 mount_fs+0xa3/0x310 fs/super.c:1261
 vfs_kern_mount.part.0+0x68/0x470 fs/namespace.c:961
 vfs_kern_mount fs/namespace.c:951 [inline]
 do_new_mount fs/namespace.c:2492 [inline]
 do_mount+0x115c/0x2f50 fs/namespace.c:2822
 ksys_mount+0xcf/0x130 fs/namespace.c:3038
 __do_sys_mount fs/namespace.c:3052 [inline]
 __se_sys_mount fs/namespace.c:3049 [inline]
 __x64_sys_mount+0xba/0x150 fs/namespace.c:3049
 do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f0b1cfef5da
Code: Bad RIP value.
RSP: 002b:00007f0b1b55ff88 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
RAX: ffffffffffffffda RBX: 00000000000124d6 RCX: 00007f0b1cfef5da
RDX: 00000000200124c0 RSI: 0000000020012500 RDI: 00007f0b1b55ffe0
RBP: 00007f0b1b560020 R08: 00007f0b1b560020 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000202 R12: 00000000200124c0
R13: 0000000020012500 R14: 00007f0b1b55ffe0 R15: 0000000020000040
INFO: task syz-executor.2:21609 blocked for more than 140 seconds.
      Not tainted 4.19.211-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.2  D26096 21609  13089 0x80000004
Call Trace:
 context_switch kernel/sched/core.c:2828 [inline]
 __schedule+0x887/0x2040 kernel/sched/core.c:3517
 schedule+0x8d/0x1b0 kernel/sched/core.c:3561
 schedule_timeout+0x92d/0xfe0 kernel/time/timer.c:1794
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common+0x29c/0x470 kernel/sched/completion.c:115
 flush_workqueue+0x40b/0x13e0 kernel/workqueue.c:2713
 gfs2_gl_hash_clear+0x98/0x250 fs/gfs2/glock.c:1639
 fill_super+0x1edb/0x2550 fs/gfs2/ops_fstype.c:1205
 gfs2_mount+0x4c0/0x5a0 fs/gfs2/ops_fstype.c:1316
 mount_fs+0xa3/0x310 fs/super.c:1261
 vfs_kern_mount.part.0+0x68/0x470 fs/namespace.c:961
 vfs_kern_mount fs/namespace.c:951 [inline]
 do_new_mount fs/namespace.c:2492 [inline]
 do_mount+0x115c/0x2f50 fs/namespace.c:2822
 ksys_mount+0xcf/0x130 fs/namespace.c:3038
 __do_sys_mount fs/namespace.c:3052 [inline]
 __se_sys_mount fs/namespace.c:3049 [inline]
 __x64_sys_mount+0xba/0x150 fs/namespace.c:3049
 do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f8ed644d5da
Code: Bad RIP value.
RSP: 002b:00007f8ed49bdf88 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
RAX: ffffffffffffffda RBX: 00000000000124d6 RCX: 00007f8ed644d5da
RDX: 00000000200124c0 RSI: 0000000020012500 RDI: 00007f8ed49bdfe0
RBP: 00007f8ed49be020 R08: 00007f8ed49be020 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000202 R12: 00000000200124c0
R13: 0000000020012500 R14: 00007f8ed49bdfe0 R15: 0000000020000040

Showing all locks held in the system:
1 lock held by khungtaskd/1569:
 #0: 00000000dc2041a7 (rcu_read_lock){....}, at: debug_show_all_locks+0x53/0x265 kernel/locking/lockdep.c:4441
3 locks held by kworker/1:1H/4663:
1 lock held by in:imklog/7811:
 #0: 0000000041bae53c (&f->f_pos_lock){+.+.}, at: __fdget_pos+0x26f/0x310 fs/file.c:767
1 lock held by syz-executor.3/8119:
 #0: 000000004ef14248 (&type->s_umount_key#84){+.+.}, at: deactivate_super+0x16c/0x1a0 fs/super.c:359
1 lock held by syz-executor.4/21561:
 #0: 000000008447bbb7 (&type->s_umount_key#47/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
 #0: 000000008447bbb7 (&type->s_umount_key#47/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519
1 lock held by syz-executor.1/21586:
 #0: 00000000109379da (&type->s_umount_key#47/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
 #0: 00000000109379da (&type->s_umount_key#47/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519
1 lock held by syz-executor.5/21589:
 #0: 0000000061f1a1df (&type->s_umount_key#47/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
 #0: 0000000061f1a1df (&type->s_umount_key#47/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519
1 lock held by syz-executor.2/21609:
 #0: 00000000c77c9b43 (&type->s_umount_key#47/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
 #0: 00000000c77c9b43 (&type->s_umount_key#47/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519
1 lock held by syz-executor.0/21662:
 #0: 00000000613dcd57 (&type->s_umount_key#47/1){+.+.}, at: alloc_super fs/super.c:226 [inline]
 #0: 00000000613dcd57 (&type->s_umount_key#47/1){+.+.}, at: sget_userns+0x20b/0xcd0 fs/super.c:519

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1569 Comm: khungtaskd Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x1fc/0x2ef lib/dump_stack.c:118
 nmi_cpu_backtrace.cold+0x63/0xa2 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x1a6/0x1f0 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:203 [inline]
 watchdog+0x991/0xe60 kernel/hung_task.c:287
 kthread+0x33f/0x460 kernel/kthread.c:259
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 4663 Comm: kworker/1:1H Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022
Workqueue: glock_workqueue glock_work_func
RIP: 0010:__sanitizer_cov_trace_pc+0x47/0x50 kernel/kcov.c:111
Code: 90 60 13 00 00 83 fa 02 75 20 48 8b 88 68 13 00 00 8b 80 64 13 00 00 48 8b 11 48 83 c2 01 48 39 d0 76 07 48 89 34 d1 48 89 11 <c3> 0f 1f 84 00 00 00 00 00 49 89 f1 49 89 fa 65 48 8b 34 25 c0 df
RSP: 0018:ffff8880a3eff7c0 EFLAGS: 00000293
RAX: ffff8880a3eee500 RBX: 0000000000000037 RCX: ffffffff87eecf4e
RDX: 0000000000000000 RSI: ffffffff87eecf21 RDI: 0000000000000007
RBP: ffff888045802520 R08: 0000000000000000 R09: 000000000000003f
R10: 0000000000000007 R11: 0000000000000000 R12: ffff888045802368
R13: 0000000000000000 R14: 0000000000000000 R15: ffff888045802340
FS:  0000000000000000(0000) GS:ffff8880ba100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c001885fb8 CR3: 00000000a8c95000 CR4: 00000000003406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 radix_tree_next_chunk+0x2e1/0xaa0 lib/radix-tree.c:1770
 find_get_entries+0x5cc/0xa90 mm/filemap.c:1659
 pagevec_lookup_entries+0x35/0x80 mm/swap.c:956
 truncate_inode_pages_range+0x1d1/0x1b00 mm/truncate.c:328
 inode_go_inval+0x163/0x4b0 fs/gfs2/glops.c:302
 do_xmote+0x336/0x670 fs/gfs2/glock.c:571
 run_queue+0x24f/0x580 fs/gfs2/glock.c:655
 glock_work_func+0x1c4/0x370 fs/gfs2/glock.c:719
 process_one_work+0x864/0x1570 kernel/workqueue.c:2153
 worker_thread+0x64c/0x1130 kernel/workqueue.c:2296
 kthread+0x33f/0x460 kernel/kthread.c:259
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/01/04 01:01 linux-4.19.y 3f8a27f9e27b f0036e18 .config console log report info [disk image] [vmlinux] ci2-linux-4-19 INFO: task hung in gfs2_gl_hash_clear
* Struck through repros no longer work on HEAD.