syzbot


INFO: task hung in f2fs_balance_fs

Status: upstream: reported C repro on 2023/03/15 03:28
Subsystems: f2fs
[Documentation on labels]
Reported-by: syzbot+8b85865808c8908a0d8c@syzkaller.appspotmail.com
First crash: 486d, last: 1d02h
Cause bisection: introduced by (bisect log) :
commit 10d0786b39b3b91c4fbf8c2926e97ab456a4eea1
Author: Jia Yang <jiayang5@huawei.com>
Date: Wed Jul 14 07:46:06 2021 +0000

  f2fs: Revert "f2fs: Fix indefinite loop in f2fs_gc() v1"

Crash: INFO: task hung in f2fs_balance_fs (log)
Repro: C syz .config
  
Discussions (8)
Title Replies (including bot) Last reply
[syzbot] Monthly f2fs report (Feb 2024) 0 (1) 2024/02/15 13:28
[syzbot] Monthly f2fs report (Nov 2023) 0 (1) 2023/11/22 09:42
[syzbot] Monthly f2fs report (Aug 2023) 0 (1) 2023/08/07 07:27
[syzbot] Monthly f2fs report (Jul 2023) 0 (1) 2023/07/07 08:54
[syzbot] Monthly f2fs report (Jun 2023) 0 (1) 2023/06/06 23:21
[syzbot] Monthly f2fs report (May 2023) 0 (1) 2023/05/05 21:40
[syzbot] Monthly f2fs report 0 (1) 2023/04/04 14:20
[syzbot] [f2fs?] INFO: task hung in f2fs_balance_fs 0 (3) 2023/03/26 16:58
Similar bugs (5)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: task hung in f2fs_balance_fs f2fs C 199 351d 490d 0/1 upstream: reported C repro on 2022/10/18 13:55
linux-6.1 INFO: task hung in f2fs_balance_fs (2) 2 85d 107d 0/3 upstream: reported on 2023/11/06 05:25
linux-4.14 INFO: task hung in f2fs_balance_fs 3 460d 486d 0/1 auto-obsoleted due to no activity on 2023/03/18 03:56
linux-6.1 INFO: task hung in f2fs_balance_fs 20 287d 350d 0/3 auto-obsoleted due to no activity on 2023/08/22 15:19
linux-5.15 INFO: task hung in f2fs_balance_fs origin:upstream C 40 40d 349d 0/3 upstream: reported C repro on 2023/03/08 13:34
Last patch testing requests (8)
Created Duration User Patch Repo Result
2024/01/22 15:27 22m retest repro upstream OK log
2024/01/22 15:27 23m retest repro upstream OK log
2024/01/22 15:27 22m retest repro upstream OK log
2024/01/22 03:03 21m retest repro upstream OK log
2023/09/22 13:47 26m retest repro upstream report log
2023/09/22 13:47 33m retest repro upstream report log
2023/03/26 11:35 22m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git 4bdec23f971b OK log
2023/03/26 07:22 16m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git 4bdec23f971b report log

Sample crash report:
INFO: task kworker/u4:9:2429 blocked for more than 143 seconds.
      Not tainted 6.8.0-rc3-syzkaller-00215-ge6f39a90de92 #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u4:9    state:D stack:20216 pid:2429  tgid:2429  ppid:2      flags:0x00004000
Workqueue: writeback wb_workfn (flush-7:0)
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5400 [inline]
 __schedule+0x177f/0x49a0 kernel/sched/core.c:6727
 __schedule_loop kernel/sched/core.c:6802 [inline]
 schedule+0x149/0x260 kernel/sched/core.c:6817
 schedule_preempt_disabled+0x13/0x30 kernel/sched/core.c:6874
 rwsem_down_write_slowpath+0xeea/0x13b0 kernel/locking/rwsem.c:1178
 __down_write_common+0x1ae/0x200 kernel/locking/rwsem.c:1306
 f2fs_down_write fs/f2fs/f2fs.h:2138 [inline]
 f2fs_balance_fs+0x500/0x730 fs/f2fs/segment.c:437
 f2fs_write_inode+0x3f0/0x470 fs/f2fs/inode.c:794
 write_inode fs/fs-writeback.c:1473 [inline]
 __writeback_single_inode+0x69f/0xfd0 fs/fs-writeback.c:1690
 writeback_sb_inodes+0x8e3/0x1220 fs/fs-writeback.c:1916
 __writeback_inodes_wb+0x11b/0x260 fs/fs-writeback.c:1987
 wb_writeback+0x461/0xc80 fs/fs-writeback.c:2094
 wb_check_background_flush fs/fs-writeback.c:2164 [inline]
 wb_do_writeback fs/fs-writeback.c:2252 [inline]
 wb_workfn+0xc33/0xfb0 fs/fs-writeback.c:2279
 process_one_work kernel/workqueue.c:2633 [inline]
 process_scheduled_works+0x913/0x1420 kernel/workqueue.c:2706
 worker_thread+0xa5f/0x1000 kernel/workqueue.c:2787
 kthread+0x2ef/0x390 kernel/kthread.c:388
 ret_from_fork+0x4b/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1b/0x30 arch/x86/entry/entry_64.S:242
 </TASK>

Showing all locks held in the system:
1 lock held by khungtaskd/29:
 #0: ffffffff8e130ae0 (rcu_read_lock){....}-{1:2}, at: rcu_lock_acquire include/linux/rcupdate.h:298 [inline]
 #0: ffffffff8e130ae0 (rcu_read_lock){....}-{1:2}, at: rcu_read_lock include/linux/rcupdate.h:750 [inline]
 #0: ffffffff8e130ae0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x55/0x2a0 kernel/locking/lockdep.c:6614
4 locks held by kworker/u4:9/2429:
 #0: ffff888018ee1d38 ((wq_completion)writeback){+.+.}-{0:0}, at: process_one_work kernel/workqueue.c:2608 [inline]
 #0: ffff888018ee1d38 ((wq_completion)writeback){+.+.}-{0:0}, at: process_scheduled_works+0x825/0x1420 kernel/workqueue.c:2706
 #1: ffffc90009ddfd20 ((work_completion)(&(&wb->dwork)->work)){+.+.}-{0:0}, at: process_one_work kernel/workqueue.c:2608 [inline]
 #1: ffffc90009ddfd20 ((work_completion)(&(&wb->dwork)->work)){+.+.}-{0:0}, at: process_scheduled_works+0x825/0x1420 kernel/workqueue.c:2706
 #2: ffff88802c72c0e0 (&type->s_umount_key#43){.+.+}-{3:3}, at: super_trylock_shared+0x22/0xf0 fs/super.c:566
 #3: ffff888078bf92a8 (&sbi->gc_lock){+.+.}-{3:3}, at: f2fs_down_write fs/f2fs/f2fs.h:2138 [inline]
 #3: ffff888078bf92a8 (&sbi->gc_lock){+.+.}-{3:3}, at: f2fs_balance_fs+0x500/0x730 fs/f2fs/segment.c:437
1 lock held by syslogd/4493:
 #0: ffff8880b953c918 (&rq->__lock){-.-.}-{2:2}, at: raw_spin_rq_lock_nested+0x2a/0x140 kernel/sched/core.c:559
2 locks held by getty/4809:
 #0: ffff88802ff920a0 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:243
 #1: ffffc90002f162f0 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0x6b4/0x1e10 drivers/tty/n_tty.c:2201
6 locks held by syz-executor242/5074:

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 29 Comm: khungtaskd Not tainted 6.8.0-rc3-syzkaller-00215-ge6f39a90de92 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/25/2024
Call Trace:
 <TASK>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1e7/0x2e0 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x49c/0x4d0 lib/nmi_backtrace.c:113
 nmi_trigger_cpumask_backtrace+0x198/0x320 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:160 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:222 [inline]
 watchdog+0xfaf/0xff0 kernel/hung_task.c:379
 kthread+0x2ef/0x390 kernel/kthread.c:388
 ret_from_fork+0x4b/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1b/0x30 arch/x86/entry/entry_64.S:242
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 22 Comm: ksoftirqd/1 Not tainted 6.8.0-rc3-syzkaller-00215-ge6f39a90de92 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/25/2024
RIP: 0010:free_unref_page_commit+0xc1/0x1140 mm/page_alloc.c:2440
Code: 04 21 84 c0 4c 89 44 24 40 0f 85 59 08 00 00 c7 84 24 a0 00 00 00 00 00 00 00 48 8d 5a 55 48 89 d8 48 c1 e8 03 42 0f b6 04 20 <84> c0 4c 89 6c 24 30 0f 85 64 08 00 00 d0 2b 41 83 f8 20 0f 83 3b
RSP: 0018:ffffc900001c78c0 EFLAGS: 00000a03
RAX: 0000000000000000 RBX: ffff8880b9542815 RCX: ffffc900001c7903
RDX: ffff8880b95427c0 RSI: ffff8880b95427c0 RDI: ffff88813fffa740
RBP: ffffc900001c79c8 R08: 0000000000000000 R09: 1ffffffff258a484
R10: dffffc0000000000 R11: fffffbfff258a485 R12: dffffc0000000000
R13: ffffea0001de7740 R14: 1ffff92000038f28 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff8880b9500000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055ba051976d0 CR3: 000000001e5ba000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 free_unref_page+0x17c/0x3f0 mm/page_alloc.c:2509
 rcu_do_batch kernel/rcu/tree.c:2190 [inline]
 rcu_core+0xd76/0x1810 kernel/rcu/tree.c:2465
 __do_softirq+0x2bb/0x942 kernel/softirq.c:553
 run_ksoftirqd+0xc5/0x130 kernel/softirq.c:921
 smpboot_thread_fn+0x543/0xa30 kernel/smpboot.c:164
 kthread+0x2ef/0x390 kernel/kthread.c:388
 ret_from_fork+0x4b/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1b/0x30 arch/x86/entry/entry_64.S:242
 </TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.759 msecs

Crashes (316):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/02/10 05:12 upstream e6f39a90de92 77b23aa1 .config console log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/16 23:52 upstream 7475e51b8796 cb976f63 .config console log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/09/04 07:11 upstream db906f0ca6bb 696ea0d2 .config strace log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] ci-upstream-kasan-gce-smack-root INFO: task hung in f2fs_balance_fs
2023/06/09 08:31 upstream 25041a4c02c7 7086cdb9 .config strace log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2023/03/26 05:17 upstream 4bdec23f971b fbf0499a .config strace log report syz C [disk image] [vmlinux] [kernel image] [mounted in repro] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2024/02/18 07:12 upstream ced590523156 578f7538 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2024/02/09 09:25 upstream 1f719a2f3fa6 7f07e9b0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2024/02/08 17:15 upstream 047371968ffc 7f07e9b0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2024/01/08 00:28 upstream 0dd3ee311255 d0304e9c .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2024/01/05 18:24 upstream 1f874787ed9a 28c42cff .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2024/01/01 19:32 upstream 610a9b8f49fb fb427a07 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/25 13:41 upstream 861deac3b092 fb427a07 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/24 14:14 upstream 861deac3b092 fb427a07 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/24 09:46 upstream 3f82f1c3a036 fb427a07 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/23 07:18 upstream 5254c0cbc92d fb427a07 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/18 04:15 upstream 0e389834672c 3222d10c .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/16 02:14 upstream 3bd7d7488169 3222d10c .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/11 07:38 upstream a39b6ac3781d 28b24332 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/10 08:53 upstream b10a3ccaf6e3 28b24332 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/07 18:12 upstream bee0e7762ad2 0a02ce36 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/02 12:14 upstream 815fb87b7530 f819d6f7 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: task hung in f2fs_balance_fs
2023/12/02 06:23 upstream 815fb87b7530 f819d6f7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/12/01 07:15 upstream e8f60209d6cf f819d6f7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/27 06:32 upstream d2da77f431ac 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/27 03:01 upstream d2da77f431ac 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/25 10:36 upstream 0f5cc96c367f 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2023/11/25 02:38 upstream f1a09972a45a 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2023/11/24 21:30 upstream f1a09972a45a 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/22 14:46 upstream c2d5304e6c64 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/21 18:50 upstream 98b1cc82c4af cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/20 16:36 upstream 98b1cc82c4af cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/19 23:53 upstream eb3479bc23fa cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/19 19:27 upstream 037266a5f723 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/17 06:03 upstream 7475e51b8796 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/16 06:50 upstream c42d9eeef8e5 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/15 20:02 upstream c42d9eeef8e5 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/15 12:15 upstream c42d9eeef8e5 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/14 20:47 upstream 9bacdd8996c7 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/14 00:41 upstream 9bacdd8996c7 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/13 16:30 upstream b85ea95d0864 6d6dbf8a .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/13 15:16 upstream b85ea95d0864 6d6dbf8a .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/12 17:06 upstream 1b907d050735 6d6dbf8a .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/11 05:28 upstream ac347a0655db d80eec66 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/09 11:23 upstream 6bc986ab839c 4862372a .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/08 10:31 upstream 305230142ae0 83211397 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/08 06:40 upstream 13d88ac54ddd 83211397 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2023/11/08 00:28 upstream 13d88ac54ddd 83211397 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2023/11/07 21:06 upstream be3ca57cfb77 83211397 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2023/11/07 14:47 upstream be3ca57cfb77 83211397 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/06 00:13 upstream 1c41041124bd 500bfdc4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/11/04 07:03 upstream 8f6f76a6a29f 500bfdc4 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2023/10/28 13:10 upstream 56567a20b22b 3c418d72 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/10/12 21:34 upstream 401644852d0b fc170927 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: task hung in f2fs_balance_fs
2023/03/04 22:39 upstream 0988a0ea7919 f8902b57 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in f2fs_balance_fs
2022/10/23 06:03 upstream 4da34b7d175d c0b80a55 .config console log report info [disk image] [vmlinux] ci2-upstream-fs INFO: task hung in f2fs_balance_fs
2023/08/30 21:17 linux-next 56585460cc2e 84803932 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: task hung in f2fs_balance_fs
2024/02/20 07:15 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 83d49ede4b18 3af7dd65 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 INFO: task hung in f2fs_balance_fs
2023/06/26 05:50 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci e40939bbfc68 09ffe269 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 INFO: task hung in f2fs_balance_fs
* Struck through repros no longer work on HEAD.