syzbot


INFO: task hung in xfs_buf_item_unpin (2)

Status: upstream: reported C repro on 2024/08/16 05:17
Subsystems: xfs
[Documentation on labels]
Reported-by: syzbot+837bcd54843dd6262f2f@syzkaller.appspotmail.com
First crash: 89d, last: 3d10h
Cause bisection: introduced by (bisect log) :
commit 3eb96946f0be6bf447cbdf219aba22bc42672f92
Author: Christoph Hellwig <hch@lst.de>
Date: Wed May 24 06:05:38 2023 +0000

  block: make bio_check_eod work for zero sized devices

Crash: INFO: task hung in xfs_buf_item_unpin (log)
Repro: C syz .config
  
Discussions (1)
Title Replies (including bot) Last reply
[syzbot] [xfs?] INFO: task hung in xfs_buf_item_unpin (2) 1 (4) 2024/08/19 22:16
Similar bugs (3)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-5.15 INFO: task hung in xfs_buf_item_unpin 2 507d 519d 0/3 auto-obsoleted due to no activity on 2023/08/21 23:02
upstream INFO: task hung in xfs_buf_item_unpin xfs C error done 147 255d 562d 0/27 auto-obsoleted due to no activity on 2024/03/11 08:02
linux-6.1 INFO: task hung in xfs_buf_item_unpin 10 437d 548d 0/3 auto-obsoleted due to no activity on 2023/10/11 09:07

Sample crash report:
INFO: task kworker/0:1H:43 blocked for more than 143 seconds.
      Not tainted 6.11.0-rc3-syzkaller-00271-g85652baa895b #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/0:1H    state:D stack:26736 pid:43    tgid:43    ppid:2      flags:0x00004000
Workqueue: xfs-log/loop0 xlog_ioend_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5188 [inline]
 __schedule+0x17ae/0x4a10 kernel/sched/core.c:6529
 __schedule_loop kernel/sched/core.c:6606 [inline]
 schedule+0x14b/0x320 kernel/sched/core.c:6621
 schedule_timeout+0xb0/0x310 kernel/time/timer.c:2557
 ___down_common kernel/locking/semaphore.c:225 [inline]
 __down_common+0x343/0x7f0 kernel/locking/semaphore.c:246
 down+0x84/0xc0 kernel/locking/semaphore.c:63
 xfs_buf_lock+0x164/0x510 fs/xfs/xfs_buf.c:1196
 xfs_buf_item_unpin+0x1dd/0x710 fs/xfs/xfs_buf_item.c:582
 xlog_cil_committed+0x82f/0xf00 fs/xfs/xfs_log_cil.c:910
 xlog_cil_process_committed+0x15c/0x1b0 fs/xfs/xfs_log_cil.c:941
 xlog_state_shutdown_callbacks+0x2ba/0x3b0 fs/xfs/xfs_log.c:487
 xlog_force_shutdown+0x32c/0x390 fs/xfs/xfs_log.c:3530
 xlog_ioend_work+0xad/0x100 fs/xfs/xfs_log.c:1244
 process_one_work kernel/workqueue.c:3231 [inline]
 process_scheduled_works+0xa2c/0x1830 kernel/workqueue.c:3312
 worker_thread+0x86d/0xd40 kernel/workqueue.c:3390
 kthread+0x2f0/0x390 kernel/kthread.c:389
 ret_from_fork+0x4b/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>
INFO: task syz-executor224:5234 blocked for more than 143 seconds.
      Not tainted 6.11.0-rc3-syzkaller-00271-g85652baa895b #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:syz-executor224 state:D stack:22224 pid:5234  tgid:5234  ppid:5232   flags:0x00004006
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5188 [inline]
 __schedule+0x17ae/0x4a10 kernel/sched/core.c:6529
 __schedule_loop kernel/sched/core.c:6606 [inline]
 schedule+0x14b/0x320 kernel/sched/core.c:6621
 xlog_wait fs/xfs/xfs_log_priv.h:587 [inline]
 xlog_wait_on_iclog+0x501/0x770 fs/xfs/xfs_log.c:840
 xlog_force_lsn+0x523/0x9e0 fs/xfs/xfs_log.c:3066
 xfs_log_force_seq+0x1da/0x450 fs/xfs/xfs_log.c:3103
 __xfs_trans_commit+0xb98/0x1290 fs/xfs/xfs_trans.c:900
 xfs_sync_sb_buf+0x2dc/0x370 fs/xfs/libxfs/xfs_sb.c:1178
 xfs_ioc_setlabel fs/xfs/xfs_ioctl.c:1143 [inline]
 xfs_file_ioctl+0x165b/0x19e0 fs/xfs/xfs_ioctl.c:1298
 vfs_ioctl fs/ioctl.c:51 [inline]
 __do_sys_ioctl fs/ioctl.c:907 [inline]
 __se_sys_ioctl+0xfc/0x170 fs/ioctl.c:893
 do_syscall_x64 arch/x86/entry/common.c:52 [inline]
 do_syscall_64+0xf3/0x230 arch/x86/entry/common.c:83
 entry_SYSCALL_64_after_hwframe+0x77/0x7f
RIP: 0033:0x7f816deedc99
RSP: 002b:00007fff94625058 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
RAX: ffffffffffffffda RBX: 0000000020000100 RCX: 00007f816deedc99
RDX: 0000000020000340 RSI: 0000000041009432 RDI: 0000000000000006
RBP: 00007f816df6a5f0 R08: 00005555629df4c0 R09: 00005555629df4c0
R10: 00005555629df4c0 R11: 0000000000000246 R12: 00007fff94625080
R13: 00007fff946252a8 R14: 431bde82d7b634db R15: 00007f816df3603b
 </TASK>

Showing all locks held in the system:
1 lock held by khungtaskd/30:
 #0: ffffffff8e7382e0 (rcu_read_lock){....}-{1:2}, at: rcu_lock_acquire include/linux/rcupdate.h:326 [inline]
 #0: ffffffff8e7382e0 (rcu_read_lock){....}-{1:2}, at: rcu_read_lock include/linux/rcupdate.h:838 [inline]
 #0: ffffffff8e7382e0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x55/0x2a0 kernel/locking/lockdep.c:6626
2 locks held by kworker/0:1H/43:
 #0: ffff888022723148 ((wq_completion)xfs-log/loop0){+.+.}-{0:0}, at: process_one_work kernel/workqueue.c:3206 [inline]
 #0: ffff888022723148 ((wq_completion)xfs-log/loop0){+.+.}-{0:0}, at: process_scheduled_works+0x90a/0x1830 kernel/workqueue.c:3312
 #1: ffffc90000b37d00 ((work_completion)(&iclog->ic_end_io_work)){+.+.}-{0:0}, at: process_one_work kernel/workqueue.c:3207 [inline]
 #1: ffffc90000b37d00 ((work_completion)(&iclog->ic_end_io_work)){+.+.}-{0:0}, at: process_scheduled_works+0x945/0x1830 kernel/workqueue.c:3312
2 locks held by getty/4972:
 #0: ffff8880303d20a0 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:243
 #1: ffffc900031332f0 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0x6ac/0x1e00 drivers/tty/n_tty.c:2211
1 lock held by syz-executor224/5234:
 #0: ffff8880118c2420 (sb_writers#9){.+.+}-{0:0}, at: mnt_want_write_file+0x61/0x200 fs/namespace.c:559

=============================================

NMI backtrace for cpu 0
CPU: 0 UID: 0 PID: 30 Comm: khungtaskd Not tainted 6.11.0-rc3-syzkaller-00271-g85652baa895b #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024
Call Trace:
 <TASK>
 __dump_stack lib/dump_stack.c:93 [inline]
 dump_stack_lvl+0x241/0x360 lib/dump_stack.c:119
 nmi_cpu_backtrace+0x49c/0x4d0 lib/nmi_backtrace.c:113
 nmi_trigger_cpumask_backtrace+0x198/0x320 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:162 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:223 [inline]
 watchdog+0xff4/0x1040 kernel/hung_task.c:379
 kthread+0x2f0/0x390 kernel/kthread.c:389
 ret_from_fork+0x4b/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 UID: 0 PID: 1057 Comm: kworker/u8:5 Not tainted 6.11.0-rc3-syzkaller-00271-g85652baa895b #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:preempt_count_add+0x6/0x190 kernel/sched/core.c:5643
Code: 48 8b 3c 24 e8 cb aa 94 00 eb 8c e9 ee fe ff ff 0f 1f 40 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 41 57 <41> 56 53 89 fb 48 c7 c0 c0 a9 ce 94 48 c1 e8 03 49 bf 00 00 00 00
RSP: 0018:ffffc90003b77498 EFLAGS: 00000002
RAX: 0000000000000002 RBX: ffff8880b933e9c0 RCX: ffffffff94cea903
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001
RBP: 0000000000000000 R08: ffffffff813578d1 R09: 1ffff11017267d38
R10: dffffc0000000000 R11: ffffed1017267d39 R12: dffffc0000000000
R13: 00000000fffffabc R14: ffffc90003b77600 R15: ffffffff8e080a48
FS:  0000000000000000(0000) GS:ffff8880b9300000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005628b5ca0680 CR3: 000000000e534000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 _raw_spin_lock_nested+0x15/0x40 kernel/locking/spinlock.c:377
 raw_spin_rq_lock_nested+0x2a/0x140 kernel/sched/core.c:560
 raw_spin_rq_lock kernel/sched/sched.h:1415 [inline]
 _raw_spin_rq_lock_irqsave kernel/sched/sched.h:1435 [inline]
 rq_lock_irqsave kernel/sched/sched.h:1700 [inline]
 sched_balance_update_blocked_averages+0x140/0x16a0 kernel/sched/fair.c:9490
 sched_balance_newidle+0x49a/0xfd0 kernel/sched/fair.c:12412
 pick_next_task_fair+0x27a/0xde0 kernel/sched/fair.c:8582
 __pick_next_task+0xb0/0x2c0 kernel/sched/core.c:5812
 __schedule+0x728/0x4a10 kernel/sched/core.c:6484
 __schedule_loop kernel/sched/core.c:6606 [inline]
 schedule+0x14b/0x320 kernel/sched/core.c:6621
 toggle_allocation_gate+0x16a/0x250 mm/kfence/core.c:835
 process_one_work kernel/workqueue.c:3231 [inline]
 process_scheduled_works+0xa2c/0x1830 kernel/workqueue.c:3312
 worker_thread+0x86d/0xd40 kernel/workqueue.c:3390
 kthread+0x2f0/0x390 kernel/kthread.c:389
 ret_from_fork+0x4b/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.477 msecs

Crashes (73):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/08/17 09:18 upstream 85652baa895b dbc93b08 .config strace log report syz / log C [disk image] [vmlinux] [kernel image] [mounted in repro] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/09/09 03:37 upstream 89f5e14d05b4 9750182a .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/09/06 07:27 upstream ad618736883b 464ac2ed .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/09/05 01:46 upstream c7fb1692dc01 dfbe2ed4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/27 11:29 upstream 3e9bff3bbe13 9aee4e0b .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/23 20:03 upstream 3d5f968a177d d7d32352 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/23 10:36 upstream aa0743a22936 ce8a9099 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/18 20:50 upstream c3f2d783a459 dbc93b08 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/17 16:01 upstream e5fa841af679 dbc93b08 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/17 16:01 upstream e5fa841af679 dbc93b08 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/17 03:38 upstream 85652baa895b dbc93b08 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/15 06:29 upstream 1fb918967b56 e4bacdaf .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/14 21:54 upstream 9d5906799f7d e6b88e20 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/14 19:09 upstream 9d5906799f7d e6b88e20 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/14 19:09 upstream 9d5906799f7d e6b88e20 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/14 14:56 upstream 6b0f8db921ab e6b88e20 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/13 14:34 upstream d74da846046a f21a18ca .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/13 14:34 upstream d74da846046a f21a18ca .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/13 09:40 upstream d74da846046a 7b0f4b46 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/13 09:38 upstream d74da846046a 7b0f4b46 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/13 09:14 upstream d74da846046a 7b0f4b46 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/13 09:14 upstream d74da846046a 7b0f4b46 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/13 09:13 upstream d74da846046a 7b0f4b46 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/12 21:28 upstream 7c626ce4bae1 842184b3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/12 04:58 upstream 7006fe2f7f78 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 21:44 upstream 7006fe2f7f78 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 19:55 upstream 5189dafa4cf9 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 12:35 upstream 5189dafa4cf9 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 07:34 upstream 5189dafa4cf9 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:57 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:55 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:55 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:55 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:51 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:50 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:47 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:46 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/11 05:46 upstream 34ac1e82e5a7 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/10 11:26 upstream afdab700f65e 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/08 10:15 upstream 6a0e38264012 de12cf65 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/08/01 02:56 upstream 21b136cc63d2 1e9c4cf3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/07/26 14:13 upstream 1722389b0d86 3f86dfed .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/07/02 22:22 upstream 1dfe225e9af5 07f0a0a0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/07/01 00:09 upstream e0b668b07034 757f06b1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-fs INFO: task hung in xfs_buf_item_unpin
2024/06/18 00:30 upstream 2ccbdf43d5e7 1f11cfd7 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: task hung in xfs_buf_item_unpin
2024/06/17 07:40 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: task hung in xfs_buf_item_unpin
2024/06/17 07:39 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: task hung in xfs_buf_item_unpin
2024/06/16 19:23 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in xfs_buf_item_unpin
2024/06/15 16:08 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in xfs_buf_item_unpin
2024/06/15 15:54 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: task hung in xfs_buf_item_unpin
2024/06/15 14:40 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in xfs_buf_item_unpin
2024/06/15 14:38 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: task hung in xfs_buf_item_unpin
2024/06/15 13:52 upstream 2ccbdf43d5e7 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: task hung in xfs_buf_item_unpin
2024/07/22 07:35 linux-next 41c196e567fb b88348e9 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: task hung in xfs_buf_item_unpin
* Struck through repros no longer work on HEAD.