syzbot |
sign-in | mailing list | source | docs |
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: 1-...!: (1 ticks this GP) idle=449/1/0x4000000000000000 softirq=78919/78919 fqs=0 rcu: Tasks blocked on level-0 rcu_node (CPUs 0-1): P2611/1:b..l (detected by 0, t=10504 jiffies, g=115697, q=115) Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 26 Comm: kauditd Not tainted 5.15.144-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/17/2023 RIP: 0010:lookup_chain_cache kernel/locking/lockdep.c:3681 [inline] RIP: 0010:lookup_chain_cache_add kernel/locking/lockdep.c:3701 [inline] RIP: 0010:validate_chain+0x1af/0x5930 kernel/locking/lockdep.c:3756 Code: c3 f8 74 42 4c 8d 7b 18 4c 89 f8 48 c1 e8 03 42 80 3c 20 00 74 08 4c 89 ff e8 1d a5 66 00 49 8b 07 4c 39 f0 0f 84 d4 03 00 00 <48> 83 c3 08 48 89 d8 48 c1 e8 03 42 80 3c 20 00 74 ba 48 89 df e8 RSP: 0018:ffffc90000dd07c0 EFLAGS: 00000816 RAX: b132c5872abc5680 RBX: ffffffff8fd66060 RCX: ffffffff81633742 RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff8fbcf0c8 RBP: ffffc90000dd0a70 R08: dffffc0000000000 R09: fffffbfff1f79e1a R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000 R13: ffff8880167e0b38 R14: 4b21b045db16ba9e R15: ffffffff8fd66078 FS: 0000000000000000(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000555555753918 CR3: 000000003b1ab000 CR4: 00000000003506e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: <NMI> </NMI> <IRQ> __lock_acquire+0x1295/0x1ff0 kernel/locking/lockdep.c:5012 lock_acquire+0x1db/0x4f0 kernel/locking/lockdep.c:5623 __raw_spin_lock_irq include/linux/spinlock_api_smp.h:128 [inline] _raw_spin_lock_irq+0xcf/0x110 kernel/locking/spinlock.c:170 __run_hrtimer kernel/time/hrtimer.c:1689 [inline] __hrtimer_run_queues+0x662/0xcf0 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline] __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096 </IRQ> <TASK> asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:console_unlock+0xe53/0x12b0 kernel/printk/printk.c:2743 Code: 00 48 83 7c 24 18 00 75 19 e8 a9 f9 19 00 eb 18 e8 a2 f9 19 00 e8 cd ba b5 08 48 83 7c 24 18 00 74 e7 e8 90 f9 19 00 fb 31 ff <44> 89 f6 e8 e5 fc 19 00 31 db 45 85 f6 0f 95 c0 89 c1 0a 4c 24 17 RSP: 0018:ffffc90000e1f920 EFLAGS: 00000246 RAX: ffffffff81662de0 RBX: 0000000000000000 RCX: ffff8880167e0000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: ffffc90000e1fbb0 R08: ffffffff81662dab R09: fffffbfff1f79e19 R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffffffff1a498d6 R13: ffffffff8d24c6e8 R14: 0000000000000000 R15: dffffc0000000000 vprintk_emit+0xbf/0x150 kernel/printk/printk.c:2268 _printk+0xd1/0x111 kernel/printk/printk.c:2293 kauditd_printk_skb kernel/audit.c:538 [inline] kauditd_hold_skb+0x1b5/0x200 kernel/audit.c:573 kauditd_send_queue+0x2a3/0x2f0 kernel/audit.c:758 kauditd_thread+0x6fb/0xae0 kernel/audit.c:882 kthread+0x3f6/0x4f0 kernel/kthread.c:319 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298 </TASK> task:kworker/u4:5 state:R running task stack:20792 pid: 2611 ppid: 2 flags:0x00004000 Workqueue: bat_events batadv_nc_worker Call Trace: <TASK> context_switch kernel/sched/core.c:5030 [inline] __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6780 irqentry_exit+0x53/0x80 kernel/entry/common.c:426 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:lock_acquire+0x252/0x4f0 kernel/locking/lockdep.c:5627 Code: 2b 00 74 08 4c 89 f7 e8 dc 5c 67 00 f6 44 24 61 02 0f 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25 RSP: 0018:ffffc9000b7cfa80 EFLAGS: 00000206 RAX: 0000000000000001 RBX: 1ffff920016f9f5c RCX: 1ffff920016f9efc RDX: dffffc0000000000 RSI: ffffffff8a8b2220 RDI: ffffffff8ad88040 RBP: ffffc9000b7cfbd8 R08: dffffc0000000000 R09: fffffbfff1f79e19 R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff920016f9f58 R13: dffffc0000000000 R14: ffffc9000b7cfae0 R15: 0000000000000246 rcu_lock_acquire+0x2a/0x30 include/linux/rcupdate.h:269 rcu_read_lock include/linux/rcupdate.h:696 [inline] batadv_nc_purge_orig_hash net/batman-adv/network-coding.c:412 [inline] batadv_nc_worker+0xc1/0x5b0 net/batman-adv/network-coding.c:723 process_one_work+0x8a1/0x10c0 kernel/workqueue.c:2310 worker_thread+0xaca/0x1280 kernel/workqueue.c:2457 kthread+0x3f6/0x4f0 kernel/kthread.c:319 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298 </TASK> rcu: rcu_preempt kthread timer wakeup didn't happen for 10503 jiffies! g115697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 rcu: Possible timer handling issue on cpu=1 timer-softirq=108317 rcu: rcu_preempt kthread starved for 10504 jiffies! g115697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:I stack:26200 pid: 15 ppid: 2 flags:0x00004000 Call Trace: <TASK> context_switch kernel/sched/core.c:5030 [inline] __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376 schedule+0x11b/0x1f0 kernel/sched/core.c:6459 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1884 rcu_gp_fqs_loop+0x2bf/0x1080 kernel/rcu/tree.c:1972 rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2145 kthread+0x3f6/0x4f0 kernel/kthread.c:319 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298 </TASK> rcu: Stack dump where RCU GP kthread last ran: Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 26 Comm: kauditd Not tainted 5.15.144-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/17/2023 RIP: 0010:__lock_acquire+0xd75/0x1ff0 Code: 3c 91 48 c1 e8 03 0f b6 04 38 84 c0 0f 85 d0 0d 00 00 83 3d 4c de d9 0f 00 b8 01 00 00 00 75 0a 49 83 ff ff 0f 85 b8 08 00 00 <89> 44 24 2c 48 89 d8 48 c1 e8 03 80 3c 38 00 74 12 48 89 df e8 d2 RSP: 0018:ffffc90000dd0a60 EFLAGS: 00000002 RAX: 0000000000000000 RBX: ffff8880167e0b18 RCX: ffffffff816290ff RDX: 0000000000000000 RSI: 0000000000000008 RDI: dffffc0000000000 RBP: ffff8880167e0ae0 R08: dffffc0000000000 R09: fffffbfff1f79e5d R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000001 R13: ffff8880167e0ae8 R14: 1ffff11002cfc15c R15: c02fe89a5612156a FS: 0000000000000000(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000555555753918 CR3: 000000003b1ab000 CR4: 00000000003506e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: <NMI> </NMI> <IRQ> lock_acquire+0x1db/0x4f0 kernel/locking/lockdep.c:5623 __raw_spin_lock include/linux/spinlock_api_smp.h:142 [inline] _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154 spin_lock include/linux/spinlock.h:363 [inline] advance_sched+0x47/0x940 net/sched/sch_taprio.c:716 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x598/0xcf0 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline] __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096 </IRQ> <TASK> asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:console_unlock+0xe53/0x12b0 kernel/printk/printk.c:2743 Code: 00 48 83 7c 24 18 00 75 19 e8 a9 f9 19 00 eb 18 e8 a2 f9 19 00 e8 cd ba b5 08 48 83 7c 24 18 00 74 e7 e8 90 f9 19 00 fb 31 ff <44> 89 f6 e8 e5 fc 19 00 31 db 45 85 f6 0f 95 c0 89 c1 0a 4c 24 17 RSP: 0018:ffffc90000e1f920 EFLAGS: 00000246 RAX: ffffffff81662de0 RBX: 0000000000000000 RCX: ffff8880167e0000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: ffffc90000e1fbb0 R08: ffffffff81662dab R09: fffffbfff1f79e19 R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffffffff1a498d6 R13: ffffffff8d24c6e8 R14: 0000000000000000 R15: dffffc0000000000 vprintk_emit+0xbf/0x150 kernel/printk/printk.c:2268 _printk+0xd1/0x111 kernel/printk/printk.c:2293 kauditd_printk_skb kernel/audit.c:538 [inline] kauditd_hold_skb+0x1b5/0x200 kernel/audit.c:573 kauditd_send_queue+0x2a3/0x2f0 kernel/audit.c:758 kauditd_thread+0x6fb/0xae0 kernel/audit.c:882 kthread+0x3f6/0x4f0 kernel/kthread.c:319 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298 </TASK> watchdog: BUG: soft lockup - CPU#0 stuck for 246s! [kworker/0:2:16653] Modules linked in: irq event stamp: 1407384 hardirqs last enabled at (1407383): [<ffffffff8a400cc6>] asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638 hardirqs last disabled at (1407384): [<ffffffff8a1bdc1a>] sysvec_apic_timer_interrupt+0xa/0xb0 arch/x86/kernel/apic/apic.c:1096 softirqs last enabled at (1357406): [<ffffffff814d5cc5>] invoke_softirq kernel/softirq.c:432 [inline] softirqs last enabled at (1357406): [<ffffffff814d5cc5>] __irq_exit_rcu+0x155/0x240 kernel/softirq.c:637 softirqs last disabled at (1357073): [<ffffffff814d5cc5>] invoke_softirq kernel/softirq.c:432 [inline] softirqs last disabled at (1357073): [<ffffffff814d5cc5>] __irq_exit_rcu+0x155/0x240 kernel/softirq.c:637 CPU: 0 PID: 16653 Comm: kworker/0:2 Not tainted 5.15.144-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/17/2023 Workqueue: events bpf_prog_free_deferred RIP: 0010:__sanitizer_cov_trace_pc+0x58/0x60 kernel/kcov.c:207 Code: 10 16 00 00 83 fa 02 75 21 48 8b 91 18 16 00 00 48 8b 32 48 8d 7e 01 8b 89 14 16 00 00 48 39 cf 73 08 48 89 44 f2 08 48 89 3a <c3> 0f 1f 80 00 00 00 00 4c 8b 04 24 65 48 8b 15 e4 47 82 7e 65 8b RSP: 0018:ffffc90004867898 EFLAGS: 00000293 RAX: ffffffff81745f34 RBX: 1ffff11017367f31 RCX: ffff888090483b80 RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffc900048679e0 R08: ffffffff81745f04 R09: fffffbfff1f79e1a R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000001 R13: ffff8880b9b3f988 R14: ffff8880b9a3a780 R15: 0000000000000001 FS: 0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000001b2f823000 CR3: 000000008be20000 CR4: 00000000003506f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: <IRQ> </IRQ> <TASK> csd_lock_wait kernel/smp.c:440 [inline] smp_call_function_many_cond+0xab4/0xd90 kernel/smp.c:969 on_each_cpu_cond_mask+0x3b/0x80 kernel/smp.c:1135 __purge_vmap_area_lazy+0x294/0x1740 mm/vmalloc.c:1683 _vm_unmap_aliases+0x453/0x4e0 mm/vmalloc.c:2107 vm_remove_mappings mm/vmalloc.c:2584 [inline] __vunmap+0x72e/0xa20 mm/vmalloc.c:2611 bpf_jit_binary_free kernel/bpf/core.c:914 [inline] bpf_jit_free+0x92/0x180 kernel/bpf/core.c:927 process_one_work+0x8a1/0x10c0 kernel/workqueue.c:2310 worker_thread+0xaca/0x1280 kernel/workqueue.c:2457 kthread+0x3f6/0x4f0 kernel/kthread.c:319 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298 </TASK> Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 26 Comm: kauditd Not tainted 5.15.144-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/17/2023 RIP: 0010:bytes_is_nonzero mm/kasan/generic.c:84 [inline] RIP: 0010:memory_is_nonzero mm/kasan/generic.c:102 [inline] RIP: 0010:memory_is_poisoned_n mm/kasan/generic.c:128 [inline] RIP: 0010:memory_is_poisoned mm/kasan/generic.c:159 [inline] RIP: 0010:check_region_inline mm/kasan/generic.c:180 [inline] RIP: 0010:kasan_check_range+0x71/0x290 mm/kasan/generic.c:189 Code: 54 37 ff 49 c1 ea 03 49 bb 01 00 00 00 00 fc ff df 4f 8d 34 1a 4c 89 f5 4c 29 cd 48 83 fd 10 7f 26 48 85 ed 0f 84 3a 01 00 00 <49> f7 d2 49 01 da 41 80 39 00 0f 85 c4 01 00 00 49 ff c1 49 ff c2 RSP: 0018:ffffc90000dd09f0 EFLAGS: 00000002 RAX: 0000000000000001 RBX: 1ffffffff1f79e5c RCX: ffffffff8162eb78 RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff8fbcf2e0 RBP: 0000000000000001 R08: dffffc0000000000 R09: fffffbfff1f79e5c R10: 1ffffffff1f79e5c R11: dffffc0000000001 R12: 0000000000000001 R13: dffffc0000000000 R14: fffffbfff1f79e5d R15: ffff8880167e0b18 FS: 0000000000000000(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000555555753918 CR3: 000000003b1ab000 CR4: 00000000003506e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: <NMI> </NMI> <IRQ> instrument_atomic_read include/linux/instrumented.h:71 [inline] test_bit include/asm-generic/bitops/instrumented-non-atomic.h:134 [inline] hlock_class kernel/locking/lockdep.c:197 [inline] mark_lock+0x98/0x340 kernel/locking/lockdep.c:4569 mark_usage kernel/locking/lockdep.c:4512 [inline] __lock_acquire+0xc97/0x1ff0 kernel/locking/lockdep.c:4966 lock_acquire+0x1db/0x4f0 kernel/locking/lockdep.c:5623 __raw_spin_lock include/linux/spinlock_api_smp.h:142 [inline] _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154 spin_lock include/linux/spinlock.h:363 [inline] advance_sched+0x47/0x940 net/sched/sch_taprio.c:716 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x598/0xcf0 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline] __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096 </IRQ> <TASK> asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:console_unlock+0xe53/0x12b0 kernel/printk/printk.c:2743 Code: 00 48 83 7c 24 18 00 75 19 e8 a9 f9 19 00 eb 18 e8 a2 f9 19 00 e8 cd ba b5 08 48 83 7c 24 18 00 74 e7 e8 90 f9 19 00 fb 31 ff <44> 89 f6 e8 e5 fc 19 00 31 db 45 85 f6 0f 95 c0 89 c1 0a 4c 24 17 RSP: 0018:ffffc90000e1f920 EFLAGS: 00000246 RAX: ffffffff81662de0 RBX: 0000000000000000 RCX: ffff8880167e0000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: ffffc90000e1fbb0 R08: ffffffff81662dab R09: fffffbfff1f79e19 R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffffffff1a498d6 R13: ffffffff8d24c6e8 R14: 0000000000000000 R15: dffffc0000000000 vprintk_emit+0xbf/0x150 kernel/printk/printk.c:2268 _printk+0xd1/0x111 kernel/printk/printk.c:2293 kauditd_printk_skb kernel/audit.c:538 [inline] kauditd_hold_skb+0x1b5/0x200 kernel/audit.c:573 kauditd_send_queue+0x2a3/0x2f0 kernel/audit.c:758 kauditd_thread+0x6fb/0xae0 kernel/audit.c:882 kthread+0x3f6/0x4f0 kernel/kthread.c:319 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298 </TASK>
Time | Kernel | Commit | Syzkaller | Config | Log | Report | Syz repro | C repro | VM info | Assets (help?) | Manager | Title |
---|---|---|---|---|---|---|---|---|---|---|---|---|
2023/12/22 22:44 | linux-5.15.y | 1d146b1875fc | fb427a07 | .config | console log | report | info | [disk image] [vmlinux] [kernel image] | ci2-linux-5-15-kasan | INFO: rcu detected stall in kauditd_thread | ||
2023/12/05 23:05 | linux-5.15.y | 9b91d36ba301 | 858d62d1 | .config | console log | report | info | [disk image] [vmlinux] [kernel image] | ci2-linux-5-15-kasan | INFO: rcu detected stall in kauditd_thread |