syzbot


INFO: task hung in f2fs_balance_fs

Status: upstream: reported C repro on 2023/03/08 13:34
Bug presence: origin:upstream
[Documentation on labels]
Reported-by: syzbot+3b1c9adc2b5043073aab@syzkaller.appspotmail.com
First crash: 408d, last: 27d
Bug presence (2)
Date Name Commit Repro Result
2023/05/19 upstream (ToT) 2d1bcbc6cd70 C [report] INFO: task hung in f2fs_balance_fs
2024/04/10 upstream (ToT) 2c71fdf02a95 C Failed due to an error; will retry later
Similar bugs (6)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: task hung in f2fs_balance_fs f2fs C 199 410d 549d 0/1 upstream: reported C repro on 2022/10/18 13:55
linux-6.1 INFO: task hung in f2fs_balance_fs (2) 2 144d 166d 0/3 auto-obsoleted due to no activity on 2024/03/06 18:04
linux-6.1 INFO: task hung in f2fs_balance_fs (3) 2 17h40m 24d 0/3 upstream: reported on 2024/03/27 06:53
linux-4.14 INFO: task hung in f2fs_balance_fs 3 519d 545d 0/1 auto-obsoleted due to no activity on 2023/03/18 03:56
upstream INFO: task hung in f2fs_balance_fs f2fs C done inconclusive 355 40d 402d 0/26 upstream: reported C repro on 2023/03/15 03:28
linux-6.1 INFO: task hung in f2fs_balance_fs 20 346d 409d 0/3 auto-obsoleted due to no activity on 2023/08/22 15:19
Fix bisection attempts (7)
Created Duration User Patch Repo Result
2024/03/23 08:33 1h36m bisect fix linux-5.15.y job log (0) log
2024/02/21 20:28 1h31m bisect fix linux-5.15.y job log (0) log
2024/01/11 21:13 2h22m bisect fix linux-5.15.y job log (0) log
2023/12/12 07:07 1h26m bisect fix linux-5.15.y job log (0) log
2023/10/26 21:01 1h27m bisect fix linux-5.15.y job log (0) log
2023/09/09 03:03 2h10m bisect fix linux-5.15.y job log (0) log
2023/06/18 19:46 35m bisect fix linux-5.15.y job log (0) log

Sample crash report:
INFO: task kworker/u4:4:1188 blocked for more than 143 seconds.
      Not tainted 5.15.138-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u4:4    state:D stack:19520 pid: 1188 ppid:     2 flags:0x00004000
Workqueue: writeback wb_workfn (flush-7:0)
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5026 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6372
 schedule+0x11b/0x1f0 kernel/sched/core.c:6455
 rwsem_down_write_slowpath+0xebb/0x15c0 kernel/locking/rwsem.c:1157
 __down_write_common kernel/locking/rwsem.c:1284 [inline]
 __down_write kernel/locking/rwsem.c:1293 [inline]
 down_write+0x164/0x170 kernel/locking/rwsem.c:1542
 f2fs_balance_fs+0x4d4/0x6a0 fs/f2fs/segment.c:529
 f2fs_write_inode+0x4c3/0x540 fs/f2fs/inode.c:727
 write_inode fs/fs-writeback.c:1478 [inline]
 __writeback_single_inode+0x644/0xe30 fs/fs-writeback.c:1688
 writeback_sb_inodes+0xbce/0x1a40 fs/fs-writeback.c:1913
 __writeback_inodes_wb+0x114/0x400 fs/fs-writeback.c:1984
 wb_writeback+0x465/0xc50 fs/fs-writeback.c:2089
 wb_check_background_flush fs/fs-writeback.c:2155 [inline]
 wb_do_writeback fs/fs-writeback.c:2243 [inline]
 wb_workfn+0xd07/0x1130 fs/fs-writeback.c:2271
 process_one_work+0x8a1/0x10c0 kernel/workqueue.c:2310
 worker_thread+0xaca/0x1280 kernel/workqueue.c:2457
 kthread+0x3f6/0x4f0 kernel/kthread.c:319
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298
 </TASK>

Showing all locks held in the system:
1 lock held by khungtaskd/27:
 #0: ffffffff8c91f020 (rcu_read_lock){....}-{1:2}, at: rcu_lock_acquire+0x0/0x30
4 locks held by kworker/u4:4/1188:
 #0: ffff8881431ce938 ((wq_completion)writeback){+.+.}-{0:0}, at: process_one_work+0x78a/0x10c0 kernel/workqueue.c:2283
 #1: ffffc900054a7d20 ((work_completion)(&(&wb->dwork)->work)){+.+.}-{0:0}, at: process_one_work+0x7d0/0x10c0 kernel/workqueue.c:2285
 #2: ffff888078e600e0 (&type->s_umount_key#43){.+.+}-{3:3}, at: trylock_super+0x1b/0xf0 fs/super.c:418
 #3: ffff888078561108 (&sbi->gc_lock){+.+.}-{3:3}, at: f2fs_balance_fs+0x4d4/0x6a0 fs/f2fs/segment.c:529
2 locks held by getty/3261:
 #0: ffff888023c7f098 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x21/0x70 drivers/tty/tty_ldisc.c:252
 #1: ffffc900020a32e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0x6af/0x1db0 drivers/tty/n_tty.c:2158
4 locks held by syz-executor154/3523:

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 27 Comm: khungtaskd Not tainted 5.15.138-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/09/2023
Call Trace:
 <TASK>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1e3/0x2cb lib/dump_stack.c:106
 nmi_cpu_backtrace+0x46a/0x4a0 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x181/0x2a0 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:148 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:210 [inline]
 watchdog+0xe72/0xeb0 kernel/hung_task.c:295
 kthread+0x3f6/0x4f0 kernel/kthread.c:319
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 3523 Comm: syz-executor154 Not tainted 5.15.138-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/09/2023
RIP: 0010:separate_irq_context kernel/locking/lockdep.c:4526 [inline]
RIP: 0010:__lock_acquire+0xda4/0x1ff0 kernel/locking/lockdep.c:4995
Code: 89 d8 48 c1 e8 03 80 3c 38 00 74 12 48 89 df e8 12 48 67 00 48 bf 00 00 00 00 00 fc ff df 4c 89 3b 48 8b 44 24 40 0f b6 04 38 <84> c0 0f 85 54 0b 00 00 41 8b 5d 00 48 85 db 48 8b 0c 24 74 56 83
RSP: 0018:ffffc9000231ee00 EFLAGS: 00000046
RAX: 0000000000000000 RBX: ffff8880729c8b90 RCX: ffffffff81628f9f
RDX: 0000000000000000 RSI: 0000000000000008 RDI: dffffc0000000000
RBP: ffff8880729c8ae0 R08: dffffc0000000000 R09: fffffbfff1f79c3a
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000004
R13: ffff8880729c8ae8 R14: 1ffff1100e53915c R15: 4d5ea02f98a35e77
FS:  0000555555de2380(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ffde4497338 CR3: 000000001ab22000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 lock_acquire+0x1db/0x4f0 kernel/locking/lockdep.c:5622
 down_read+0x45/0x2e0 kernel/locking/rwsem.c:1488
 check_valid_map fs/f2fs/gc.c:881 [inline]
 gc_data_segment fs/f2fs/gc.c:1450 [inline]
 do_garbage_collect+0x20d8/0x7600 fs/f2fs/gc.c:1670
 f2fs_gc+0x9e5/0x1ad0 fs/f2fs/gc.c:1764
 f2fs_balance_fs+0x4e8/0x6a0 fs/f2fs/segment.c:530
 f2fs_map_blocks+0x1989/0x28d0 fs/f2fs/data.c:1672
 expand_inode_data+0x5ba/0x9d0 fs/f2fs/file.c:1697
 f2fs_fallocate+0x35a/0x820 fs/f2fs/file.c:1787
 vfs_fallocate+0x54a/0x6b0 fs/open.c:308
 ksys_fallocate fs/open.c:331 [inline]
 __do_sys_fallocate fs/open.c:339 [inline]
 __se_sys_fallocate fs/open.c:337 [inline]
 __x64_sys_fallocate+0xb9/0x100 fs/open.c:337
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3d/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x61/0xcb
RIP: 0033:0x7f467b501b59
Code: 28 00 00 00 75 05 48 83 c4 28 c3 e8 f1 17 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007ffdcde3ecd8 EFLAGS: 00000246 ORIG_RAX: 000000000000011d
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f467b501b59
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000005
RBP: 00007f467b57a5f0 R08: 0000555555de34c0 R09: 0000555555de34c0
R10: 0000000008800000 R11: 0000000000000246 R12: 00007ffdcde3ed00
R13: 00007ffdcde3ef28 R14: 431bde82d7b634db R15: 00007f467b54a03b
 </TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.452 msecs

Crashes (40):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/11/10 00:29 linux-5.15.y 80529b4968a8 56230772 .config console log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/19 05:22 linux-5.15.y 9d6bde853685 3bb7af1d .config console log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/11 05:52 linux-5.15.y 80529b4968a8 d80eec66 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/09 19:58 linux-5.15.y 80529b4968a8 56230772 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/09 07:27 linux-5.15.y 80529b4968a8 4862372a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/08 21:06 linux-5.15.y 80529b4968a8 b93f63e8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/07 22:39 linux-5.15.y 12952a23a5da 83211397 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/06 04:55 linux-5.15.y 12952a23a5da 500bfdc4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/04 07:34 linux-5.15.y 12952a23a5da 500bfdc4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/11/04 06:56 linux-5.15.y 12952a23a5da 500bfdc4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/09/22 13:23 linux-5.15.y 35ecaa3632bf 0b6a67ac .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/06/27 02:34 linux-5.15.y f67653019430 4cd5bb25 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/06/25 11:54 linux-5.15.y f67653019430 79782afc .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/06/23 11:29 linux-5.15.y f67653019430 79782afc .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/06/23 09:21 linux-5.15.y f67653019430 79782afc .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/10 18:18 linux-5.15.y 8a7f2a5c5aa1 14b12a99 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/05 02:46 linux-5.15.y 8a7f2a5c5aa1 518a39a6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/03 22:14 linux-5.15.y 8a7f2a5c5aa1 b5918830 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/03 15:48 linux-5.15.y 8a7f2a5c5aa1 b5918830 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/03 03:33 linux-5.15.y 8a7f2a5c5aa1 48e0a81d .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/03 02:08 linux-5.15.y 8a7f2a5c5aa1 48e0a81d .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/02 00:13 linux-5.15.y 8a7f2a5c5aa1 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/01 15:14 linux-5.15.y 8a7f2a5c5aa1 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/01 09:23 linux-5.15.y 8a7f2a5c5aa1 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/05/01 07:08 linux-5.15.y 8a7f2a5c5aa1 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/04/29 09:05 linux-5.15.y f48aeeaaa64c 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/04/29 06:55 linux-5.15.y f48aeeaaa64c 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/04/01 21:33 linux-5.15.y c957cbb87315 f325deb0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/30 09:09 linux-5.15.y 115472395b0a f325deb0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/28 12:57 linux-5.15.y 115472395b0a 47f3aaf1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/25 17:48 linux-5.15.y 115472395b0a fbf0499a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/25 02:47 linux-5.15.y 115472395b0a 9700afae .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/19 22:10 linux-5.15.y 8020ae3c051d 7939252e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/15 20:24 linux-5.15.y 2ddbd0f967b3 18b58603 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/08 17:22 linux-5.15.y d9b4a0c83a2d 4fc6d98d .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/03/08 13:34 linux-5.15.y d9b4a0c83a2d d2b00170 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: task hung in f2fs_balance_fs
2023/06/26 12:56 linux-5.15.y f67653019430 79782afc .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-arm64 INFO: task hung in f2fs_balance_fs
2023/04/10 18:28 linux-5.15.y d86dfc4d95cd 71147e29 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-arm64 INFO: task hung in f2fs_balance_fs
2023/04/06 19:53 linux-5.15.y d86dfc4d95cd 08707520 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-arm64 INFO: task hung in f2fs_balance_fs
2023/04/01 21:34 linux-5.15.y c957cbb87315 f325deb0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-arm64 INFO: task hung in f2fs_balance_fs
* Struck through repros no longer work on HEAD.