INFO: rcu detected stall in rtnl

Kernel	Title	Repro	Fix bisect	Count	Last	Reported	Patched	Status
linux-5.15	INFO: rcu detected stall in rtnl_setlink origin:lts-only	C	inconclusive	16	228d	390d	0/3	auto-obsoleted due to no activity on 2024/10/03 07:39
linux-4.14	BUG: soft lockup in rtnl_setlink			1	892d	892d	0/1	auto-obsoleted due to no activity on 2022/09/10 23:34
android-5-15	BUG: soft lockup in rtnl_setlink			1	177d	177d	0/2	auto-obsoleted due to no activity on 2024/07/27 10:01

rcu: INFO: rcu_preempt self-detected stall on CPU rcu: 1-...!: (10494 ticks this GP) idle=4ae/1/0x4000000000000000 softirq=180394/180394 fqs=0 (t=10502 jiffies g=333185 q=2118) rcu: rcu_preempt kthread timer wakeup didn't happen for 10502 jiffies! g333185 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 rcu: Possible timer handling issue on cpu=1 timer-softirq=128614 rcu: rcu_preempt kthread starved for 10505 jiffies! g333185 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:I stack:28864 pid: 14 ppid: 2 flags:0x00004000 Call Trace: context_switch kernel/sched/core.c:4681 [inline] __schedule+0x93a/0x26f0 kernel/sched/core.c:5938 schedule+0xd3/0x270 kernel/sched/core.c:6017 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1881 rcu_gp_fqs_loop kernel/rcu/tree.c:1996 [inline] rcu_gp_kthread+0xd34/0x1980 kernel/rcu/tree.c:2169 kthread+0x3e5/0x4d0 kernel/kthread.c:319 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295 rcu: Stack dump where RCU GP kthread last ran: NMI backtrace for cpu 1 CPU: 1 PID: 12327 Comm: syz-executor.4 Not tainted 5.14.0-rc7-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: <IRQ> __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:105 nmi_cpu_backtrace.cold+0x44/0xd7 lib/nmi_backtrace.c:105 nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_check_gp_kthread_starvation.cold+0x1d1/0x1d6 kernel/rcu/tree_stall.h:479 print_cpu_stall kernel/rcu/tree_stall.h:623 [inline] check_cpu_stall kernel/rcu/tree_stall.h:700 [inline] rcu_pending kernel/rcu/tree.c:3922 [inline] rcu_sched_clock_irq.cold+0x9a/0x747 kernel/rcu/tree.c:2641 update_process_times+0x16d/0x200 kernel/time/timer.c:1785 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:226 tick_sched_timer+0x1b0/0x2d0 kernel/time/tick-sched.c:1421 __run_hrtimer kernel/time/hrtimer.c:1537 [inline] __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1601 hrtimer_interrupt+0x330/0xa00 kernel/time/hrtimer.c:1663 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1089 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1106 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1100 </IRQ> asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:native_irq_disable arch/x86/include/asm/irqflags.h:40 [inline] RIP: 0010:arch_local_irq_disable arch/x86/include/asm/irqflags.h:75 [inline] RIP: 0010:arch_local_irq_save arch/x86/include/asm/irqflags.h:107 [inline] RIP: 0010:lock_is_held_type+0x54/0x140 kernel/locking/lockdep.c:5664 Code: c0 0f 85 c8 00 00 00 65 4c 8b 24 25 40 f0 01 00 41 8b 94 24 ec 09 00 00 85 d2 0f 85 af 00 00 00 48 89 fd 41 89 f6 9c 8f 04 24 <fa> 48 c7 c7 20 de 8b 89 31 db e8 6d 0e 00 00 41 8b 84 24 e8 09 00 RSP: 0018:ffffc9000ec7ecd8 EFLAGS: 00000246 RAX: 0000000000000000 RBX: 1ffff92001d8fda7 RCX: 0000000000000001 RDX: 0000000000000000 RSI: 00000000ffffffff RDI: ffffffff8b97c1c0 RBP: ffffffff8b97c1c0 R08: 0000000000000000 R09: ffffffff8d6c8257 R10: fffffbfff1ad904a R11: 0000000000000000 R12: ffff88807c920000 R13: 00000000ffffffff R14: 00000000ffffffff R15: 0000000000000000 lock_is_held include/linux/lockdep.h:283 [inline] rcu_read_lock_sched_held+0x3a/0x70 kernel/rcu/update.c:125 trace_lock_acquire include/trace/events/lock.h:13 [inline] lock_acquire+0x442/0x510 kernel/locking/lockdep.c:5596 __raw_spin_lock_bh include/linux/spinlock_api_smp.h:135 [inline] _raw_spin_lock_bh+0x2f/0x40 kernel/locking/spinlock.c:175 spin_lock_bh include/linux/spinlock.h:359 [inline] batadv_tt_local_purge+0x114/0x370 net/batman-adv/translation-table.c:1367 batadv_tt_local_resize_to_mtu+0x8e/0x130 net/batman-adv/translation-table.c:3987 batadv_update_min_mtu net/batman-adv/hard-interface.c:627 [inline] batadv_hard_if_event+0x67d/0x15b0 net/batman-adv/hard-interface.c:963 notifier_call_chain+0xb5/0x200 kernel/notifier.c:83 call_netdevice_notifiers_info+0xb5/0x130 net/core/dev.c:2123 call_netdevice_notifiers_mtu net/core/dev.c:2172 [inline] dev_set_mtu_ext+0x397/0x5a0 net/core/dev.c:8964 do_setlink+0x5d6/0x3960 net/core/rtnetlink.c:2685 rtnl_setlink+0x24d/0x3c0 net/core/rtnetlink.c:3015 rtnetlink_rcv_msg+0x413/0xb80 net/core/rtnetlink.c:5575 netlink_rcv_skb+0x153/0x420 net/netlink/af_netlink.c:2504 netlink_unicast_kernel net/netlink/af_netlink.c:1314 [inline] netlink_unicast+0x533/0x7d0 net/netlink/af_netlink.c:1340 netlink_sendmsg+0x86d/0xdb0 net/netlink/af_netlink.c:1929 sock_sendmsg_nosec net/socket.c:703 [inline] sock_sendmsg+0xcf/0x120 net/socket.c:723 sock_write_iter+0x289/0x3c0 net/socket.c:1056 call_write_iter include/linux/fs.h:2114 [inline] do_iter_readv_writev+0x46f/0x740 fs/read_write.c:740 do_iter_write+0x188/0x670 fs/read_write.c:866 vfs_writev+0x1aa/0x630 fs/read_write.c:939 do_writev+0x27f/0x300 fs/read_write.c:982 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x44/0xae RIP: 0033:0x4665f9 Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007f1e8db68188 EFLAGS: 00000246 ORIG_RAX: 0000000000000014 RAX: ffffffffffffffda RBX: 000000000056bf80 RCX: 00000000004665f9 RDX: 0000000000000001 RSI: 0000000020000140 RDI: 0000000000000004 RBP: 00000000004bfcc4 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 000000000056bf80 R13: 00007ffd8f37e5cf R14: 00007f1e8db68300 R15: 0000000000022000 NMI backtrace for cpu 1 CPU: 1 PID: 12327 Comm: syz-executor.4 Not tainted 5.14.0-rc7-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: <IRQ> __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:105 nmi_cpu_backtrace.cold+0x44/0xd7 lib/nmi_backtrace.c:105 nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_dump_cpu_stacks+0x25e/0x3f0 kernel/rcu/tree_stall.h:342 print_cpu_stall kernel/rcu/tree_stall.h:625 [inline] check_cpu_stall kernel/rcu/tree_stall.h:700 [inline] rcu_pending kernel/rcu/tree.c:3922 [inline] rcu_sched_clock_irq.cold+0x9f/0x747 kernel/rcu/tree.c:2641 update_process_times+0x16d/0x200 kernel/time/timer.c:1785 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:226 tick_sched_timer+0x1b0/0x2d0 kernel/time/tick-sched.c:1421 __run_hrtimer kernel/time/hrtimer.c:1537 [inline] __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1601 hrtimer_interrupt+0x330/0xa00 kernel/time/hrtimer.c:1663 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1089 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1106 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1100 </IRQ> asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:native_irq_disable arch/x86/include/asm/irqflags.h:40 [inline] RIP: 0010:arch_local_irq_disable arch/x86/include/asm/irqflags.h:75 [inline] RIP: 0010:arch_local_irq_save arch/x86/include/asm/irqflags.h:107 [inline] RIP: 0010:lock_is_held_type+0x54/0x140 kernel/locking/lockdep.c:5664 Code: c0 0f 85 c8 00 00 00 65 4c 8b 24 25 40 f0 01 00 41 8b 94 24 ec 09 00 00 85 d2 0f 85 af 00 00 00 48 89 fd 41 89 f6 9c 8f 04 24 <fa> 48 c7 c7 20 de 8b 89 31 db e8 6d 0e 00 00 41 8b 84 24 e8 09 00 RSP: 0018:ffffc9000ec7ecd8 EFLAGS: 00000246 RAX: 0000000000000000 RBX: 1ffff92001d8fda7 RCX: 0000000000000001 RDX: 0000000000000000 RSI: 00000000ffffffff RDI: ffffffff8b97c1c0 RBP: ffffffff8b97c1c0 R08: 0000000000000000 R09: ffffffff8d6c8257 R10: fffffbfff1ad904a R11: 0000000000000000 R12: ffff88807c920000 R13: 00000000ffffffff R14: 00000000ffffffff R15: 0000000000000000 lock_is_held include/linux/lockdep.h:283 [inline] rcu_read_lock_sched_held+0x3a/0x70 kernel/rcu/update.c:125 trace_lock_acquire include/trace/events/lock.h:13 [inline] lock_acquire+0x442/0x510 kernel/locking/lockdep.c:5596 __raw_spin_lock_bh include/linux/spinlock_api_smp.h:135 [inline] _raw_spin_lock_bh+0x2f/0x40 kernel/locking/spinlock.c:175 spin_lock_bh include/linux/spinlock.h:359 [inline] batadv_tt_local_purge+0x114/0x370 net/batman-adv/translation-table.c:1367 batadv_tt_local_resize_to_mtu+0x8e/0x130 net/batman-adv/translation-table.c:3987 batadv_update_min_mtu net/batman-adv/hard-interface.c:627 [inline] batadv_hard_if_event+0x67d/0x15b0 net/batman-adv/hard-interface.c:963 notifier_call_chain+0xb5/0x200 kernel/notifier.c:83 call_netdevice_notifiers_info+0xb5/0x130 net/core/dev.c:2123 call_netdevice_notifiers_mtu net/core/dev.c:2172 [inline] dev_set_mtu_ext+0x397/0x5a0 net/core/dev.c:8964 do_setlink+0x5d6/0x3960 net/core/rtnetlink.c:2685 rtnl_setlink+0x24d/0x3c0 net/core/rtnetlink.c:3015 rtnetlink_rcv_msg+0x413/0xb80 net/core/rtnetlink.c:5575 netlink_rcv_skb+0x153/0x420 net/netlink/af_netlink.c:2504 netlink_unicast_kernel net/netlink/af_netlink.c:1314 [inline] netlink_unicast+0x533/0x7d0 net/netlink/af_netlink.c:1340 netlink_sendmsg+0x86d/0xdb0 net/netlink/af_netlink.c:1929 sock_sendmsg_nosec net/socket.c:703 [inline] sock_sendmsg+0xcf/0x120 net/socket.c:723 sock_write_iter+0x289/0x3c0 net/socket.c:1056 call_write_iter include/linux/fs.h:2114 [inline] do_iter_readv_writev+0x46f/0x740 fs/read_write.c:740 do_iter_write+0x188/0x670 fs/read_write.c:866 vfs_writev+0x1aa/0x630 fs/read_write.c:939 do_writev+0x27f/0x300 fs/read_write.c:982 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x44/0xae RIP: 0033:0x4665f9 Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007f1e8db68188 EFLAGS: 00000246 ORIG_RAX: 0000000000000014 RAX: ffffffffffffffda RBX: 000000000056bf80 RCX: 00000000004665f9 RDX: 0000000000000001 RSI: 0000000020000140 RDI: 0000000000000004 RBP: 00000000004bfcc4 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 000000000056bf80 R13: 00007ffd8f37e5cf R14: 00007f1e8db68300 R15: 0000000000022000 ---------------- Code disassembly (best guess): 0: c0 0f 85 rorb $0x85,(%rdi) 3: c8 00 00 00 enterq $0x0,$0x0 7: 65 4c 8b 24 25 40 f0 mov %gs:0x1f040,%r12 e: 01 00 10: 41 8b 94 24 ec 09 00 mov 0x9ec(%r12),%edx 17: 00 18: 85 d2 test %edx,%edx 1a: 0f 85 af 00 00 00 jne 0xcf 20: 48 89 fd mov %rdi,%rbp 23: 41 89 f6 mov %esi,%r14d 26: 9c pushfq 27: 8f 04 24 popq (%rsp) * 2a: fa cli <-- trapping instruction 2b: 48 c7 c7 20 de 8b 89 mov $0xffffffff898bde20,%rdi 32: 31 db xor %ebx,%ebx 34: e8 6d 0e 00 00 callq 0xea6 39: 41 rex.B 3a: 8b .byte 0x8b 3b: 84 24 e8 test %ah,(%rax,%rbp,8) 3e: 09 00 or %eax,(%rax)