rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: Tasks blocked on level-0 rcu_node (CPUs 0-1): P9118/1:b..l P9051/1:b..l P1113/1:b..l
rcu: (detected by 1, t=10502 jiffies, g=60553, q=271 ncpus=2)
task:kworker/u8:9 state:R running task stack:22800 pid:1113 tgid:1113 ppid:2 flags:0x00004000
Workqueue: netns cleanup_net
Call Trace:
context_switch kernel/sched/core.c:5188 [inline]
__schedule+0xe37/0x5490 kernel/sched/core.c:6529
preempt_schedule_common+0x44/0xc0 kernel/sched/core.c:6708
preempt_schedule_thunk+0x1a/0x30 arch/x86/entry/thunk.S:12
__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
_raw_spin_unlock_irqrestore+0x61/0x80 kernel/locking/spinlock.c:194
sock_def_readable+0x160/0x610 net/core/sock.c:3374
__netlink_sendskb net/netlink/af_netlink.c:1278 [inline]
netlink_broadcast_deliver net/netlink/af_netlink.c:1408 [inline]
do_one_broadcast net/netlink/af_netlink.c:1495 [inline]
netlink_broadcast_filtered+0x96a/0xef0 net/netlink/af_netlink.c:1540
netlink_broadcast+0x39/0x50 net/netlink/af_netlink.c:1564
uevent_net_broadcast_tagged lib/kobject_uevent.c:373 [inline]
kobject_uevent_net_broadcast lib/kobject_uevent.c:413 [inline]
kobject_uevent_env+0x12b3/0x1860 lib/kobject_uevent.c:608
device_add+0x10e0/0x1a70 drivers/base/core.c:3663
netdev_register_kobject+0x187/0x3f0 net/core/net-sysfs.c:2136
register_netdevice+0x1473/0x1e90 net/core/dev.c:10444
nsim_init_netdevsim drivers/net/netdevsim/netdev.c:690 [inline]
nsim_create+0x740/0xb20 drivers/net/netdevsim/netdev.c:750
__nsim_dev_port_add+0x42c/0x7d0 drivers/net/netdevsim/dev.c:1390
nsim_dev_port_add_all drivers/net/netdevsim/dev.c:1446 [inline]
nsim_dev_reload_create drivers/net/netdevsim/dev.c:1498 [inline]
nsim_dev_reload_up+0x5b6/0x860 drivers/net/netdevsim/dev.c:985
devlink_reload+0x31a/0x7c0 net/devlink/dev.c:474
devlink_pernet_pre_exit+0x1a1/0x2b0 net/devlink/core.c:509
ops_pre_exit_list net/core/net_namespace.c:163 [inline]
cleanup_net+0x488/0xbb0 net/core/net_namespace.c:620
process_one_work+0x9c5/0x1b40 kernel/workqueue.c:3231
process_scheduled_works kernel/workqueue.c:3312 [inline]
worker_thread+0x6c8/0xed0 kernel/workqueue.c:3389
kthread+0x2c1/0x3a0 kernel/kthread.c:389
ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
task:udevd state:R running task stack:26656 pid:9051 tgid:9051 ppid:4676 flags:0x00000002
Call Trace:
context_switch kernel/sched/core.c:5188 [inline]
__schedule+0xe37/0x5490 kernel/sched/core.c:6529
preempt_schedule_irq+0x51/0x90 kernel/sched/core.c:6851
irqentry_exit+0x36/0x90 kernel/entry/common.c:354
asm_sysvec_reschedule_ipi+0x1a/0x20 arch/x86/include/asm/idtentry.h:707
RIP: 0010:lock_acquire+0x1f2/0x560 kernel/locking/lockdep.c:5727
Code: c1 05 7a ca 98 7e 83 f8 01 0f 85 ea 02 00 00 9c 58 f6 c4 02 0f 85 d5 02 00 00 48 85 ed 74 01 fb 48 b8 00 00 00 00 00 fc ff df <48> 01 c3 48 c7 03 00 00 00 00 48 c7 43 08 00 00 00 00 48 8b 84 24
RSP: 0018:ffffc9000f1d7970 EFLAGS: 00000206
RAX: dffffc0000000000 RBX: 1ffff92001e3af30 RCX: 0000000000000001
RDX: 0000000000000001 RSI: ffffffff8b4cda40 RDI: ffffffff8bb0f900
RBP: 0000000000000200 R08: 0000000000000000 R09: fffffbfff2d244e0
R10: ffffffff96922707 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000000 R14: ffffffff8ddb9fe0 R15: 0000000000000000
rcu_lock_acquire include/linux/rcupdate.h:326 [inline]
rcu_read_lock include/linux/rcupdate.h:838 [inline]
is_bpf_text_address+0x36/0x1a0 kernel/bpf/core.c:767
kernel_text_address kernel/extable.c:125 [inline]
kernel_text_address+0x8d/0x100 kernel/extable.c:94
__kernel_text_address+0xd/0x40 kernel/extable.c:79
unwind_get_return_address+0x7c/0xe0 arch/x86/kernel/unwind_orc.c:369
arch_stack_walk+0xc1/0x170 arch/x86/kernel/stacktrace.c:26
stack_trace_save+0x95/0xd0 kernel/stacktrace.c:122
kasan_save_stack+0x33/0x60 mm/kasan/common.c:47
kasan_save_track+0x14/0x30 mm/kasan/common.c:68
unpoison_slab_object mm/kasan/common.c:312 [inline]
__kasan_slab_alloc+0x89/0x90 mm/kasan/common.c:338
kasan_slab_alloc include/linux/kasan.h:201 [inline]
slab_post_alloc_hook mm/slub.c:3988 [inline]
slab_alloc_node mm/slub.c:4037 [inline]
kmem_cache_alloc_noprof+0x121/0x2f0 mm/slub.c:4044
getname_flags.part.0+0x4c/0x550 fs/namei.c:139
getname_flags+0x93/0xf0 include/linux/audit.h:322
getname fs/namei.c:225 [inline]
__do_sys_rename fs/namei.c:5170 [inline]
__se_sys_rename fs/namei.c:5168 [inline]
__x64_sys_rename+0x65/0xa0 fs/namei.c:5168
do_syscall_x64 arch/x86/entry/common.c:52 [inline]
do_syscall_64+0xcd/0x250 arch/x86/entry/common.c:83
entry_SYSCALL_64_after_hwframe+0x77/0x7f
RIP: 0033:0x7f118b91093b
RSP: 002b:00007ffc826e4d18 EFLAGS: 00000202 ORIG_RAX: 0000000000000052
RAX: ffffffffffffffda RBX: 0000558e36783101 RCX: 00007f118b91093b
RDX: 0000558b617a6f10 RSI: 00007ffc826e4d38 RDI: 00007ffc826e5138
RBP: 0000558e399d4830 R08: 0000000000000006 R09: df7ef3f3c1ab6e93
R10: 000000000000010f R11: 0000000000000202 R12: 0000558e399e0220
R13: 00007ffc826e4d38 R14: 00007ffc826e5138 R15: 0000558e3676dec8
task:rm state:R running task stack:25744 pid:9118 tgid:9118 ppid:9074 flags:0x00000000
Call Trace:
context_switch kernel/sched/core.c:5188 [inline]
__schedule+0xe37/0x5490 kernel/sched/core.c:6529
preempt_schedule_irq+0x51/0x90 kernel/sched/core.c:6851
irqentry_exit+0x36/0x90 kernel/entry/common.c:354
asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702
RIP: 0010:mt_external_lock include/linux/maple_tree.h:759 [inline]
RIP: 0010:mt_locked lib/maple_tree.c:781 [inline]
RIP: 0010:mt_slot lib/maple_tree.c:788 [inline]
RIP: 0010:mas_slot lib/maple_tree.c:821 [inline]
RIP: 0010:mas_validate_parent_slot lib/maple_tree.c:7400 [inline]
RIP: 0010:mt_validate+0xa12/0x4390 lib/maple_tree.c:7589
Code: 86 f6 45 85 ff 0f 84 bf 00 00 00 e8 08 da 86 f6 49 8d 7c 24 40 48 b9 00 00 00 00 00 fc ff df 48 89 f8 48 c1 e8 03 0f b6 04 08 <84> c0 74 08 3c 03 0f 8e a6 35 00 00 41 8b 44 24 40 bf 00 03 00 00
RSP: 0018:ffffc9000c70f6e0 EFLAGS: 00000a06
RAX: 0000000000000000 RBX: 0000000000000002 RCX: dffffc0000000000
RDX: ffff88802b175a00 RSI: ffffffff8b04e5e8 RDI: ffff88807bd9cc80
RBP: ffff88802f3c2860 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffff88807bd9cc40
R13: 0000000000000003 R14: ffff888034fa5c0c R15: 0000000000000001
validate_mm+0x9c/0x4b0 mm/mmap.c:329
do_vmi_align_munmap+0x14b4/0x19c0 mm/mmap.c:2759
do_vmi_munmap+0x231/0x410 mm/mmap.c:2830
mmap_region+0x17f/0x2760 mm/mmap.c:2881
do_mmap+0xbfb/0xfb0 mm/mmap.c:1468
vm_mmap_pgoff+0x1ba/0x360 mm/util.c:588
ksys_mmap_pgoff+0x332/0x5d0 mm/mmap.c:1514
__do_sys_mmap arch/x86/kernel/sys_x86_64.c:86 [inline]
__se_sys_mmap arch/x86/kernel/sys_x86_64.c:79 [inline]
__x64_sys_mmap+0x125/0x190 arch/x86/kernel/sys_x86_64.c:79
do_syscall_x64 arch/x86/entry/common.c:52 [inline]
do_syscall_64+0xcd/0x250 arch/x86/entry/common.c:83
entry_SYSCALL_64_after_hwframe+0x77/0x7f
RIP: 0033:0x7f34219d4b74
RSP: 002b:00007ffcd1531048 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
RAX: ffffffffffffffda RBX: 00007ffcd15310f8 RCX: 00007f34219d4b74
RDX: 0000000000000003 RSI: 0000000000002000 RDI: 00007f3421729000
RBP: 00007ffcd1531420 R08: 0000000000000003 R09: 0000000000022000
R10: 0000000000000812 R11: 0000000000000246 R12: 00007f34219b1fc0
R13: 00007ffcd15314a8 R14: 0000000000021bd8 R15: 0000000000000000
rcu: rcu_preempt kthread starved for 10607 jiffies! g60553 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt state:R running task stack:27680 pid:17 tgid:17 ppid:2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:5188 [inline]
__schedule+0xe37/0x5490 kernel/sched/core.c:6529
__schedule_loop kernel/sched/core.c:6606 [inline]
schedule+0xe7/0x350 kernel/sched/core.c:6621
schedule_timeout+0x136/0x2a0 kernel/time/timer.c:2581
rcu_gp_fqs_loop+0x1eb/0xb00 kernel/rcu/tree.c:2034
rcu_gp_kthread+0x271/0x380 kernel/rcu/tree.c:2236
kthread+0x2c1/0x3a0 kernel/kthread.c:389
ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0 skipped: idling at native_safe_halt arch/x86/include/asm/irqflags.h:48 [inline]
NMI backtrace for cpu 0 skipped: idling at arch_safe_halt arch/x86/include/asm/irqflags.h:106 [inline]
NMI backtrace for cpu 0 skipped: idling at acpi_safe_halt+0x1a/0x20 drivers/acpi/processor_idle.c:111