syzbot


INFO: rcu detected stall in pwq_unbound_release_workfn (3)

Status: auto-obsoleted due to no activity on 2023/04/25 19:12
Subsystems: kernel
[Documentation on labels]
First crash: 461d, last: 461d
Similar bugs (3)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in pwq_unbound_release_workfn kernel 1 883d 883d 0/26 closed as invalid on 2022/02/08 10:10
upstream INFO: rcu detected stall in pwq_unbound_release_workfn (2) kernel 1 662d 662d 0/26 auto-closed as invalid on 2022/09/06 17:05
upstream INFO: rcu detected stall in pwq_unbound_release_workfn (4) kernel 2 295d 344d 0/26 auto-obsoleted due to no activity on 2023/10/08 15:59

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...!: (1 GPs behind) idle=a8e4/1/0x4000000000000000 softirq=162749/162750 fqs=9
	(detected by 1, t=10502 jiffies, g=208705, q=621 ncpus=2)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 27612 Comm: kworker/0:27 Not tainted 6.2.0-rc5-syzkaller-00045-g948ef7bb70c4 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/12/2023
Workqueue: events pwq_unbound_release_workfn
RIP: 0010:lockdep_recursion_finish kernel/locking/lockdep.c:466 [inline]
RIP: 0010:lock_is_held_type+0xd6/0x140 kernel/locking/lockdep.c:5712
Code: c0 74 d8 41 83 fe ff 41 bd 01 00 00 00 74 14 31 c0 41 f6 47 22 03 0f 95 c0 45 31 ed 44 39 f0 41 0f 94 c5 48 c7 c7 60 4f 4c 8a <e8> 35 15 00 00 b8 ff ff ff ff 65 0f c1 05 f0 0b fc 75 83 f8 01 75
RSP: 0018:ffffc90000007d98 EFLAGS: 00000046
RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000000001
RDX: 0000000000000000 RSI: ffffffff8c791a40 RDI: ffffffff8a4c4f60
RBP: ffffffff8c791a40 R08: 0000000000000001 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffff888030bf9d40
R13: 0000000000000000 R14: 00000000ffffffff R15: ffff888030bfa7c8
FS:  0000000000000000(0000) GS:ffff8880b9800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005605425cd900 CR3: 000000007c5fe000 CR4: 0000000000350ef0
Call Trace:
 <IRQ>
 lock_is_held include/linux/lockdep.h:283 [inline]
 rcu_read_lock_sched_held+0x3e/0x70 kernel/rcu/update.c:125
 trace_hrtimer_start include/trace/events/timer.h:198 [inline]
 debug_activate kernel/time/hrtimer.c:476 [inline]
 enqueue_hrtimer+0x328/0x470 kernel/time/hrtimer.c:1084
 __run_hrtimer kernel/time/hrtimer.c:1702 [inline]
 __hrtimer_run_queues+0xc71/0xfb0 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x320/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1096 [inline]
 __sysvec_apic_timer_interrupt+0x180/0x640 arch/x86/kernel/apic/apic.c:1113
 sysvec_apic_timer_interrupt+0x92/0xc0 arch/x86/kernel/apic/apic.c:1107
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:preempt_schedule_irq+0x4d/0xa0 kernel/sched/core.c:6918
Code: 55 53 65 48 8b 1c 25 00 ac 03 00 48 89 dd 48 c1 ed 03 48 01 c5 bf 01 00 00 00 e8 7e 83 4e f7 e8 a9 82 7f f7 fb bf 01 00 00 00 <e8> de 9e ff ff 9c 58 fa f6 c4 02 75 27 bf 01 00 00 00 e8 5c 6e 4e
RSP: 0018:ffffc9000aecfb68 EFLAGS: 00000202
RAX: 000000000001d475 RBX: ffff888030bf9d40 RCX: 1ffffffff226958e
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000001
RBP: ffffed100617f3a8 R08: 0000000000000001 R09: ffffffff91339aef
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
 irqentry_exit+0x35/0x80 kernel/entry/common.c:432
 asm_sysvec_reschedule_ipi+0x1a/0x20 arch/x86/include/asm/idtentry.h:654
RIP: 0010:lockdep_unregister_key+0x27d/0x460 kernel/locking/lockdep.c:6361
Code: e8 e8 ea ff ff 4c 89 e7 e8 40 c9 ff ff e8 eb c9 ff ff 9c 58 f6 c4 02 0f 85 43 01 00 00 41 f7 c6 00 02 00 00 0f 85 ec 00 00 00 <e8> 6e da 08 00 48 b8 00 00 00 00 00 fc ff df 49 c7 44 05 00 00 00
RSP: 0018:ffffc9000aecfc38 EFLAGS: 00000206
RAX: 0000000000000046 RBX: ffff88803a46a128 RCX: 0000000000000001
RDX: dffffc0000000000 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffff88803a46a128 R08: ffffffff8c79c040 R09: 000000001fffffff
R10: 0000000011329a60 R11: 000000000004e9e3 R12: ffffffff91331a88
R13: 1ffff920015d9f88 R14: 0000000000000246 R15: ffffffff914bcc50
 wq_unregister_lockdep kernel/workqueue.c:3497 [inline]
 pwq_unbound_release_workfn+0x258/0x340 kernel/workqueue.c:3735
 process_one_work+0x9bf/0x1710 kernel/workqueue.c:2289
 worker_thread+0x669/0x1090 kernel/workqueue.c:2436
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
rcu: rcu_preempt kthread starved for 10484 jiffies! g208705 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:28552 pid:16    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5293 [inline]
 __schedule+0xb8a/0x5450 kernel/sched/core.c:6606
 schedule+0xde/0x1b0 kernel/sched/core.c:6682
 schedule_timeout+0x14e/0x2a0 kernel/time/timer.c:2167
 rcu_gp_fqs_loop+0x190/0x910 kernel/rcu/tree.c:1656
 rcu_gp_kthread+0x23a/0x360 kernel/rcu/tree.c:1855
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
CPU: 1 PID: 4068 Comm: syz-executor.1 Not tainted 6.2.0-rc5-syzkaller-00045-g948ef7bb70c4 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/12/2023
RIP: 0010:csd_lock_wait kernel/smp.c:413 [inline]
RIP: 0010:smp_call_function_many_cond+0x444/0x10a0 kernel/smp.c:987
Code: 00 45 85 e4 74 48 48 8b 04 24 49 89 c5 83 e0 07 49 c1 ed 03 49 89 c4 4d 01 fd 41 83 c4 03 e8 33 fe 0a 00 f3 90 41 0f b6 45 00 <41> 38 c4 7c 08 84 c0 0f 85 4e 0a 00 00 8b 43 08 31 ff 83 e0 01 41
RSP: 0018:ffffc9000ba8f958 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff8880b9843ce0 RCX: ffffc9000e211000
RDX: 0000000000040000 RSI: ffffffff817663bd RDI: 0000000000000005
RBP: 0000000000000000 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000094001 R12: 0000000000000003
R13: ffffed101730879d R14: 0000000000000001 R15: dffffc0000000000
FS:  00007f9ae6cc9700(0000) GS:ffff8880b9900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbdcada8000 CR3: 000000002fe89000 CR4: 0000000000350ee0
Call Trace:
 <TASK>
 on_each_cpu_cond_mask+0x5a/0xa0 kernel/smp.c:1155
 invalidate_bdev+0x95/0xd0 block/bdev.c:85
 ntfs_loadlog_and_replay+0x236/0x5d0 fs/ntfs3/fsntfs.c:329
 ntfs_fill_super+0x2053/0x3ab0 fs/ntfs3/super.c:1053
 get_tree_bdev+0x444/0x760 fs/super.c:1282
 vfs_get_tree+0x8d/0x2f0 fs/super.c:1489
 do_new_mount fs/namespace.c:3145 [inline]
 path_mount+0x132a/0x1e20 fs/namespace.c:3475
 do_mount fs/namespace.c:3488 [inline]
 __do_sys_mount fs/namespace.c:3697 [inline]
 __se_sys_mount fs/namespace.c:3674 [inline]
 __x64_sys_mount+0x283/0x300 fs/namespace.c:3674
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x39/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f9ae5e8d5fa
Code: 48 c7 c2 b8 ff ff ff f7 d8 64 89 02 b8 ff ff ff ff eb d2 e8 b8 04 00 00 0f 1f 84 00 00 00 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f9ae6cc8f88 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5
RAX: ffffffffffffffda RBX: 000000000001f157 RCX: 00007f9ae5e8d5fa
RDX: 000000002001f180 RSI: 0000000020000040 RDI: 00007f9ae6cc8fe0
RBP: 00007f9ae6cc9020 R08: 00007f9ae6cc9020 R09: 0000000000000080
R10: 0000000000000080 R11: 0000000000000202 R12: 000000002001f180
R13: 0000000020000040 R14: 00007f9ae6cc8fe0 R15: 00000000200002c0
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/01/25 19:04 upstream 948ef7bb70c4 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in pwq_unbound_release_workfn
* Struck through repros no longer work on HEAD.