Kernel | Title | Repro | Cause bisect | Fix bisect | Count | Last | Reported | Patched | Status |
---|---|---|---|---|---|---|---|---|---|
upstream | INFO: rcu detected stall in __run_timer_base usb | C | done | done | 10 | 213d | 281d | 26/28 | fixed on 2024/07/31 23:31 |
syzbot |
sign-in | mailing list | source | docs |
Kernel | Title | Repro | Cause bisect | Fix bisect | Count | Last | Reported | Patched | Status |
---|---|---|---|---|---|---|---|---|---|
upstream | INFO: rcu detected stall in __run_timer_base usb | C | done | done | 10 | 213d | 281d | 26/28 | fixed on 2024/07/31 23:31 |
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: 1-...!: (1 GPs behind) idle=7564/1/0x4000000000000000 softirq=145314/145316 fqs=2 rcu: Tasks blocked on level-0 rcu_node (CPUs 0-1): P16380/1:b..l rcu: (detected by 0, t=10502 jiffies, g=213665, q=513 ncpus=2) Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 UID: 0 PID: 8284 Comm: syz.3.14641 Not tainted 6.11.0-rc7-syzkaller-00097-g196145c606d0 #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024 RIP: 0010:__raw_spin_lock include/linux/spinlock_api_smp.h:134 [inline] RIP: 0010:_raw_spin_lock+0x36/0x40 kernel/locking/spinlock.c:154 Code: 00 e8 8e 3a 9f f5 48 8d 7b 18 31 f6 31 d2 31 c9 41 b8 01 00 00 00 45 31 c9 ff 74 24 08 e8 12 07 ac f5 48 83 c4 08 48 89 df 5b <e9> 65 6b ad f5 0f 1f 44 00 00 90 90 90 90 90 90 90 90 90 90 90 90 RSP: 0018:ffffc90000a18868 EFLAGS: 00000096 RAX: 7e1e4af4749cca00 RBX: ffff88803dcc4036 RCX: 7e1e4af4749cca00 RDX: dffffc0000000000 RSI: ffffffff8c0ae6e0 RDI: ffff8880226ee2e8 RBP: dffffc0000000000 R08: ffffffff941e4a7f R09: 1ffffffff283c94f R10: dffffc0000000000 R11: fffffbfff283c950 R12: 0000000000000002 R13: ffffffff89c02ca0 R14: ffff8880226ee340 R15: ffff888061c164c8 FS: 00007fce0da2a6c0(0000) GS:ffff8880b8900000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000001b30b1bff8 CR3: 0000000083132000 CR4: 0000000000350ef0 Call Trace: <NMI> </NMI> <IRQ> spin_lock include/linux/spinlock.h:351 [inline] advance_sched+0xab/0xca0 net/sched/sch_taprio.c:924 __run_hrtimer kernel/time/hrtimer.c:1689 [inline] __hrtimer_run_queues+0x59d/0xd50 kernel/time/hrtimer.c:1753 hrtimer_interrupt+0x396/0x990 kernel/time/hrtimer.c:1815 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1032 [inline] __sysvec_apic_timer_interrupt+0x112/0x3f0 arch/x86/kernel/apic/apic.c:1049 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1043 [inline] sysvec_apic_timer_interrupt+0x52/0xc0 arch/x86/kernel/apic/apic.c:1043 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:160 [inline] RIP: 0010:_raw_spin_unlock_irq+0x29/0x50 kernel/locking/spinlock.c:202 Code: 90 f3 0f 1e fa 53 48 89 fb 48 83 c7 18 48 8b 74 24 08 e8 6a 29 ac f5 48 89 df e8 42 6c ad f5 e8 5d 27 d7 f5 fb bf 01 00 00 00 <e8> 52 37 9f f5 65 8b 05 23 0d 40 74 85 c0 74 06 5b e9 1c 77 2c 00 RSP: 0018:ffffc90000a18cb0 EFLAGS: 00000282 RAX: 7e1e4af4749cca00 RBX: ffff8880b892a700 RCX: ffffffff81703fea RDX: dffffc0000000000 RSI: ffffffff8c0ad560 RDI: 0000000000000001 RBP: ffffc90000a18e10 R08: ffffffff941e4877 R09: 1ffffffff283c90e R10: dffffc0000000000 R11: fffffbfff283c90f R12: ffff8880b892a748 R13: ffffc90000a18d60 R14: dffffc0000000000 R15: 0000000100020c9c __run_timer_base+0x1c0/0x8e0 kernel/time/timer.c:2429 run_timer_base kernel/time/timer.c:2437 [inline] run_timer_softirq+0xb7/0x170 kernel/time/timer.c:2447 handle_softirqs+0x2c6/0x970 kernel/softirq.c:554 __do_softirq kernel/softirq.c:588 [inline] invoke_softirq kernel/softirq.c:428 [inline] __irq_exit_rcu+0xf4/0x1c0 kernel/softirq.c:637 irq_exit_rcu+0x9/0x30 kernel/softirq.c:649 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1043 [inline] sysvec_apic_timer_interrupt+0xa6/0xc0 arch/x86/kernel/apic/apic.c:1043 </IRQ> <TASK> asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:srso_alias_safe_ret+0x0/0x7 arch/x86/lib/retpoline.S:171 Code: cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <48> 8d 64 24 08 c3 cc e8 f4 ff ff ff 0f 0b cc cc cc cc cc cc cc cc RSP: 0018:ffffc900096552d8 EFLAGS: 00000297 RAX: 0000000000000002 RBX: 00000000000b0000 RCX: 00000000000b0001 RDX: ffff888061c15a00 RSI: 000000000000d695 RDI: 00000000000b0000 RBP: 000000000000d695 R08: ffffffff81412994 R09: ffffc900096554b0 R10: 0000000000000003 R11: ffffffff817f2f80 R12: ffffc900096553c0 R13: 00000000000b0001 R14: ffffffff8c000000 R15: ffffffff81d6952c srso_alias_return_thunk+0x5/0xfbef5 arch/x86/lib/retpoline.S:181 orc_find arch/x86/kernel/unwind_orc.c:211 [inline] unwind_next_frame+0x244/0x2a00 arch/x86/kernel/unwind_orc.c:494 arch_stack_walk+0x151/0x1b0 arch/x86/kernel/stacktrace.c:25 stack_trace_save+0x118/0x1d0 kernel/stacktrace.c:122 kasan_save_stack mm/kasan/common.c:47 [inline] kasan_save_track+0x3f/0x80 mm/kasan/common.c:68 kasan_save_free_info+0x40/0x50 mm/kasan/generic.c:579 poison_slab_object+0xe0/0x150 mm/kasan/common.c:240 __kasan_slab_free+0x37/0x60 mm/kasan/common.c:256 kasan_slab_free include/linux/kasan.h:184 [inline] slab_free_hook mm/slub.c:2256 [inline] slab_free mm/slub.c:4477 [inline] kmem_cache_free+0x145/0x350 mm/slub.c:4552 free_buffer_head+0x54/0x240 fs/buffer.c:3041 try_to_free_buffers+0x311/0x5f0 fs/buffer.c:2982 shrink_folio_list+0x26c2/0x8c90 mm/vmscan.c:1413 evict_folios+0x50f7/0x7780 mm/vmscan.c:4560 try_to_shrink_lruvec+0x9ab/0xbb0 mm/vmscan.c:4755 lru_gen_shrink_lruvec mm/vmscan.c:4897 [inline] shrink_lruvec+0x551/0x3070 mm/vmscan.c:5652 shrink_node_memcgs mm/vmscan.c:5888 [inline] shrink_node+0xb09/0x3de0 mm/vmscan.c:5928 shrink_zones mm/vmscan.c:6172 [inline] do_try_to_free_pages+0x78c/0x1cf0 mm/vmscan.c:6234 try_to_free_mem_cgroup_pages+0x48f/0xb10 mm/vmscan.c:6566 try_charge_memcg+0x8c2/0x1170 mm/memcontrol.c:2210 try_charge mm/memcontrol-v1.h:20 [inline] charge_memcg+0xa2/0x160 mm/memcontrol.c:4438 __mem_cgroup_charge+0x27/0x80 mm/memcontrol.c:4453 mem_cgroup_charge include/linux/memcontrol.h:672 [inline] shmem_alloc_and_add_folio+0x88f/0x14f0 mm/shmem.c:1792 shmem_get_folio_gfp+0x8dc/0x2370 mm/shmem.c:2188 shmem_fault+0x252/0x6f0 mm/shmem.c:2388 __do_fault+0x137/0x460 mm/memory.c:4672 do_read_fault mm/memory.c:5078 [inline] do_fault mm/memory.c:5208 [inline] do_pte_missing mm/memory.c:3964 [inline] handle_pte_fault+0x321f/0x6fc0 mm/memory.c:5538 __handle_mm_fault mm/memory.c:5681 [inline] handle_mm_fault+0x1109/0x1bc0 mm/memory.c:5849 faultin_page mm/gup.c:1194 [inline] __get_user_pages+0x6ec/0x16a0 mm/gup.c:1493 populate_vma_page_range+0x264/0x330 mm/gup.c:1932 __mm_populate+0x27a/0x460 mm/gup.c:2035 mm_populate include/linux/mm.h:3430 [inline] vm_mmap_pgoff+0x2c3/0x3d0 mm/util.c:593 do_syscall_x64 arch/x86/entry/common.c:52 [inline] do_syscall_64+0xf3/0x230 arch/x86/entry/common.c:83 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7fce0cb7def9 Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007fce0da2a038 EFLAGS: 00000246 ORIG_RAX: 0000000000000009 RAX: ffffffffffffffda RBX: 00007fce0cd35f80 RCX: 00007fce0cb7def9 RDX: b635773f06ebbeee RSI: 0000000000b36000 RDI: 0000000020000000 RBP: 00007fce0cbf0b76 R08: ffffffffffffffff R09: 0000000000000000 R10: 0000000000008031 R11: 0000000000000246 R12: 0000000000000000 R13: 0000000000000000 R14: 00007fce0cd35f80 R15: 00007ffe6db37728 </TASK> task:kworker/u8:13 state:R running task stack:19160 pid:16380 tgid:16380 ppid:2 flags:0x00004000 Workqueue: bat_events batadv_nc_worker Call Trace: <TASK> context_switch kernel/sched/core.c:5188 [inline] __schedule+0x1800/0x4a60 kernel/sched/core.c:6529 preempt_schedule_irq+0xfb/0x1c0 kernel/sched/core.c:6851 irqentry_exit+0x5e/0x90 kernel/entry/common.c:354 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:lock_acquire+0x264/0x550 kernel/locking/lockdep.c:5763 Code: 2b 00 74 08 4c 89 f7 e8 5a 06 8b 00 f6 44 24 61 02 0f 85 85 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25 RSP: 0018:ffffc9000e7df9e0 EFLAGS: 00000206 RAX: 0000000000000001 RBX: 1ffff92001cfbf48 RCX: 7cdb886b3284dc00 RDX: dffffc0000000000 RSI: ffffffff8c0ae6e0 RDI: ffffffff8c608f40 RBP: ffffc9000e7dfb40 R08: ffffffff941e4847 R09: 1ffffffff283c908 R10: dffffc0000000000 R11: fffffbfff283c909 R12: 1ffff92001cfbf44 R13: dffffc0000000000 R14: ffffc9000e7dfa40 R15: 0000000000000246 rcu_lock_acquire include/linux/rcupdate.h:326 [inline] rcu_read_lock include/linux/rcupdate.h:838 [inline] batadv_nc_purge_orig_hash net/batman-adv/network-coding.c:408 [inline] batadv_nc_worker+0xec/0x610 net/batman-adv/network-coding.c:719 process_one_work kernel/workqueue.c:3231 [inline] process_scheduled_works+0xa2e/0x1830 kernel/workqueue.c:3312 worker_thread+0x870/0xd30 kernel/workqueue.c:3393 kthread+0x2f2/0x390 kernel/kthread.c:389 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 </TASK> rcu: rcu_preempt kthread starved for 10498 jiffies! g213665 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:R running task stack:25328 pid:17 tgid:17 ppid:2 flags:0x00004000 Call Trace: <TASK> context_switch kernel/sched/core.c:5188 [inline] __schedule+0x1800/0x4a60 kernel/sched/core.c:6529 __schedule_loop kernel/sched/core.c:6606 [inline] schedule+0x14b/0x320 kernel/sched/core.c:6621 schedule_timeout+0x1be/0x310 kernel/time/timer.c:2581 rcu_gp_fqs_loop+0x2df/0x1330 kernel/rcu/tree.c:2034 rcu_gp_kthread+0xa7/0x3b0 kernel/rcu/tree.c:2236 kthread+0x2f2/0x390 kernel/kthread.c:389 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 </TASK> rcu: Stack dump where RCU GP kthread last ran: CPU: 0 UID: 0 PID: 8354 Comm: syz.0.14673 Not tainted 6.11.0-rc7-syzkaller-00097-g196145c606d0 #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024 RIP: 0010:csd_lock_wait kernel/smp.c:312 [inline] RIP: 0010:smp_call_function_many_cond+0x1865/0x29d0 kernel/smp.c:856 Code: 89 e6 83 e6 01 31 ff e8 39 18 0c 00 41 83 e4 01 49 bc 00 00 00 00 00 fc ff df 75 07 e8 e4 13 0c 00 eb 38 f3 90 42 0f b6 04 23 <84> c0 75 11 41 f7 45 00 01 00 00 00 74 1e e8 c8 13 0c 00 eb e4 44 RSP: 0018:ffffc90009a5f780 EFLAGS: 00000246 RAX: 0000000000000000 RBX: 1ffff110171288f1 RCX: 0000000000040000 RDX: ffffc9000f3f9000 RSI: 000000000003ffff RDI: 0000000000040000 RBP: ffffc90009a5f948 R08: ffffffff818778b7 R09: 1ffffffff283c929 R10: dffffc0000000000 R11: fffffbfff283c92a R12: dffffc0000000000 R13: ffff8880b8944788 R14: ffff8880b883fb40 R15: 0000000000000001 FS: 00007feda27496c0(0000) GS:ffff8880b8800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f7dddc656c0 CR3: 000000007b9aa000 CR4: 0000000000350ef0 Call Trace: <IRQ> </IRQ> <TASK> on_each_cpu_cond_mask+0x3f/0x80 kernel/smp.c:1023 kill_bdev block/bdev.c:89 [inline] set_blocksize+0x2e8/0x360 block/bdev.c:172 sb_set_blocksize+0x47/0xf0 block/bdev.c:181 fat_fill_super+0xea0/0x35a0 fs/fat/inode.c:1630 get_tree_bdev+0x3f9/0x570 fs/super.c:1635 vfs_get_tree+0x92/0x2b0 fs/super.c:1800 do_new_mount+0x2be/0xb40 fs/namespace.c:3472 do_mount fs/namespace.c:3812 [inline] __do_sys_mount fs/namespace.c:4020 [inline] __se_sys_mount+0x2d6/0x3c0 fs/namespace.c:3997 do_syscall_x64 arch/x86/entry/common.c:52 [inline] do_syscall_64+0xf3/0x230 arch/x86/entry/common.c:83 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7feda197f69a Code: d8 64 89 02 48 c7 c0 ff ff ff ff eb a6 e8 de 1a 00 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007feda2748e68 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5 RAX: ffffffffffffffda RBX: 00007feda2748ef0 RCX: 00007feda197f69a RDX: 0000000020000000 RSI: 0000000020000040 RDI: 00007feda2748eb0 RBP: 0000000020000000 R08: 00007feda2748ef0 R09: 000000000300001a R10: 000000000300001a R11: 0000000000000246 R12: 0000000020000040 R13: 00007feda2748eb0 R14: 00000000000002b6 R15: 0000000020000500 </TASK>
Time | Kernel | Commit | Syzkaller | Config | Log | Report | Syz repro | C repro | VM info | Assets (help?) | Manager | Title |
---|---|---|---|---|---|---|---|---|---|---|---|---|
2024/09/13 01:53 | upstream | 196145c606d0 | 60e1a995 | .config | console log | report | info | [disk image] [vmlinux] [kernel image] | ci-upstream-kasan-gce-root | INFO: rcu detected stall in __run_timer_base |