rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: Tasks blocked on level-0 rcu_node (CPUs 0-1): P3306/1:b..l P3093/1:b..l P6302/1:b..l P3685/1:b..l (detected by 0, t=10502 jiffies, g=29189, q=22 ncpus=2) task:kworker/1:4 state:R running task stack:22560 pid:3685 ppid:2 flags:0x00004000 Workqueue: events_power_efficient gc_worker Call Trace: context_switch kernel/sched/core.c:5241 [inline] __schedule+0x143f/0x4570 kernel/sched/core.c:6558 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6870 irqentry_exit+0x53/0x80 kernel/entry/common.c:439 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:653 RIP: 0010:seqcount_lockdep_reader_access+0x1dc/0x220 include/linux/seqlock.h:105 Code: f8 4d 85 ed 75 16 e8 f3 01 ac f8 eb 15 e8 ec 01 ac f8 e8 07 2e c8 01 4d 85 ed 74 ea e8 dd 01 ac f8 fb 48 c7 04 24 0e 36 e0 45 <4b> c7 04 3c 00 00 00 00 66 43 c7 44 3c 09 00 00 43 c6 44 3c 0b 00 RSP: 0018:ffffc9000414fa40 EFLAGS: 00000293 RAX: ffffffff88dead63 RBX: 0000000000000000 RCX: ffff88807c9a5940 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: ffffc9000414faf0 R08: ffffffff88dead39 R09: fffffbfff223b856 R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000 R13: 0000000000000200 R14: 0000000000000046 R15: 1ffff92000829f48 nf_conntrack_get_ht include/net/netfilter/nf_conntrack.h:343 [inline] gc_worker+0x325/0x1530 net/netfilter/nf_conntrack_core.c:1503 process_one_work+0x8a9/0x11d0 kernel/workqueue.c:2292 worker_thread+0xa47/0x1200 kernel/workqueue.c:2439 kthread+0x28d/0x320 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295 task:udevd state:R running task stack:25080 pid:6302 ppid:3093 flags:0x00004002 Call Trace: context_switch kernel/sched/core.c:5241 [inline] __schedule+0x143f/0x4570 kernel/sched/core.c:6558 preempt_schedule_common+0x83/0xd0 kernel/sched/core.c:6727 preempt_schedule+0xd9/0xe0 kernel/sched/core.c:6751 preempt_schedule_thunk+0x16/0x18 arch/x86/entry/thunk_64.S:34 unwind_next_frame+0x1a55/0x2220 arch/x86/kernel/unwind_orc.c:629 __unwind_start+0x59d/0x720 arch/x86/kernel/unwind_orc.c:717 unwind_start arch/x86/include/asm/unwind.h:64 [inline] arch_stack_walk+0xdb/0x140 arch/x86/kernel/stacktrace.c:24 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122 save_stack+0xf6/0x1e0 mm/page_owner.c:127 __reset_page_owner+0x52/0x1a0 mm/page_owner.c:148 reset_page_owner include/linux/page_owner.h:24 [inline] free_pages_prepare mm/page_alloc.c:1444 [inline] free_pcp_prepare mm/page_alloc.c:1494 [inline] free_unref_page_prepare+0xf63/0x1120 mm/page_alloc.c:3369 free_unref_page+0x33/0x3e0 mm/page_alloc.c:3464 free_slab mm/slub.c:2031 [inline] discard_slab mm/slub.c:2037 [inline] __unfreeze_partials+0x1b7/0x210 mm/slub.c:2586 put_cpu_partial+0x17b/0x250 mm/slub.c:2662 qlink_free mm/kasan/quarantine.c:168 [inline] qlist_free_all+0x76/0xe0 mm/kasan/quarantine.c:187 kasan_quarantine_reduce+0x156/0x170 mm/kasan/quarantine.c:294 __kasan_slab_alloc+0x1f/0x70 mm/kasan/common.c:305 kasan_slab_alloc include/linux/kasan.h:201 [inline] slab_post_alloc_hook+0x52/0x3a0 mm/slab.h:737 slab_alloc_node mm/slub.c:3398 [inline] slab_alloc mm/slub.c:3406 [inline] __kmem_cache_alloc_lru mm/slub.c:3413 [inline] kmem_cache_alloc+0x10c/0x2d0 mm/slub.c:3422 getname_flags+0xb8/0x4f0 fs/namei.c:139 vfs_fstatat fs/stat.c:266 [inline] __do_sys_newfstatat fs/stat.c:437 [inline] __se_sys_newfstatat fs/stat.c:431 [inline] __x64_sys_newfstatat+0x130/0x1e0 fs/stat.c:431 do_syscall_x64 arch/x86/entry/common.c:51 [inline] do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:81 entry_SYSCALL_64_after_hwframe+0x68/0xd2 RIP: 0033:0x7f67c3f165f4 RSP: 002b:00007ffc56ad5698 EFLAGS: 00000202 ORIG_RAX: 0000000000000106 RAX: ffffffffffffffda RBX: 00007f67c3fee460 RCX: 00007f67c3f165f4 RDX: 00007ffc56ad56a0 RSI: 00007f67c3fb3130 RDI: 0000000000000008 RBP: 0000561104f61370 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000001000 R11: 0000000000000202 R12: 0000000000000000 R13: 0000000000003fff R14: 00007ffc56ad5c38 R15: 000000000000000a task:udevd state:R running task stack:22600 pid:3093 ppid:1 flags:0x00004002 Call Trace: context_switch kernel/sched/core.c:5241 [inline] __schedule+0x143f/0x4570 kernel/sched/core.c:6558 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6870 irqentry_exit+0x53/0x80 kernel/entry/common.c:439 asm_sysvec_reschedule_ipi+0x16/0x20 arch/x86/include/asm/idtentry.h:658 RIP: 0010:unwind_next_frame+0x2e/0x2220 arch/x86/kernel/unwind_orc.c:424 Code: 56 41 55 41 54 53 48 81 ec a8 00 00 00 48 89 fb 49 be 00 00 00 00 00 fc ff df 48 8d 6f 48 48 89 e8 48 c1 e8 03 48 89 44 24 30 <42> 80 3c 30 00 74 08 48 89 ef e8 c3 7c a5 00 48 89 6c 24 18 4c 8b RSP: 0018:ffffc9000312f1e0 EFLAGS: 00000a02 RAX: 1ffff92000625e61 RBX: ffffc9000312f2c0 RCX: ffffffff8fdb2000 RDX: dffffc0000000000 RSI: ffffffff81786ba3 RDI: ffffc9000312f2c0 RBP: ffffc9000312f308 R08: 0000000000000000 R09: ffffc9000312f3b0 R10: 0000000000000000 R11: dffffc0000000001 R12: ffff88807c303b80 R13: ffffffff81786c50 R14: dffffc0000000000 R15: 0000000000000000 arch_stack_walk+0x10d/0x140 arch/x86/kernel/stacktrace.c:25 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122 save_stack+0xf6/0x1e0 mm/page_owner.c:127 __reset_page_owner+0x52/0x1a0 mm/page_owner.c:148 reset_page_owner include/linux/page_owner.h:24 [inline] free_pages_prepare mm/page_alloc.c:1444 [inline] free_pcp_prepare mm/page_alloc.c:1494 [inline] free_unref_page_prepare+0xf63/0x1120 mm/page_alloc.c:3369 free_unref_page+0x33/0x3e0 mm/page_alloc.c:3464 free_slab mm/slub.c:2031 [inline] discard_slab mm/slub.c:2037 [inline] __unfreeze_partials+0x1b7/0x210 mm/slub.c:2586 put_cpu_partial+0x17b/0x250 mm/slub.c:2662 qlink_free mm/kasan/quarantine.c:168 [inline] qlist_free_all+0x76/0xe0 mm/kasan/quarantine.c:187 kasan_quarantine_reduce+0x156/0x170 mm/kasan/quarantine.c:294 __kasan_slab_alloc+0x1f/0x70 mm/kasan/common.c:305 kasan_slab_alloc include/linux/kasan.h:201 [inline] slab_post_alloc_hook+0x52/0x3a0 mm/slab.h:737 slab_alloc_node mm/slub.c:3398 [inline] __kmem_cache_alloc_node+0x137/0x260 mm/slub.c:3437 __do_kmalloc_node mm/slab_common.c:935 [inline] __kmalloc+0xa1/0x230 mm/slab_common.c:949 kmalloc include/linux/slab.h:562 [inline] tomoyo_realpath_from_path+0xcb/0x5d0 security/tomoyo/realpath.c:251 tomoyo_get_realpath security/tomoyo/file.c:151 [inline] tomoyo_path_perm+0x29f/0x710 security/tomoyo/file.c:822 security_inode_getattr+0xcf/0x120 security/security.c:1361 vfs_getattr+0x26/0x360 fs/stat.c:158 vfs_statx+0x194/0x4b0 fs/stat.c:233 vfs_fstatat fs/stat.c:267 [inline] __do_sys_newfstatat fs/stat.c:437 [inline] __se_sys_newfstatat fs/stat.c:431 [inline] __x64_sys_newfstatat+0x151/0x1e0 fs/stat.c:431 do_syscall_x64 arch/x86/entry/common.c:51 [inline] do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:81 entry_SYSCALL_64_after_hwframe+0x68/0xd2 RIP: 0033:0x7f67c3f165f4 RSP: 002b:00007ffc56ad9dc8 EFLAGS: 00000246 ORIG_RAX: 0000000000000106 RAX: ffffffffffffffda RBX: 00005610cfa216d0 RCX: 00007f67c3f165f4 RDX: 00007ffc56ad9dd8 RSI: 00005610cfa0f7ff RDI: 00000000ffffff9c RBP: 0000561104f22c28 R08: 0005f9c4183b50c0 R09: 0000000000000010 R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 R13: 0000000000000001 R14: 0005f9c4183b50c0 R15: 00005610cfa15dca task:dhcpcd state:R running task stack:24392 pid:3306 ppid:1 flags:0x00004002 Call Trace: context_switch kernel/sched/core.c:5241 [inline] __schedule+0x143f/0x4570 kernel/sched/core.c:6558 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6870 irqentry_exit+0x53/0x80 kernel/entry/common.c:439 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:653 RIP: 0010:stack_trace_consume_entry+0xa3/0x270 kernel/stacktrace.c:93 Code: 41 0f b6 44 15 00 84 c0 0f 85 65 01 00 00 44 89 37 b0 01 e9 95 00 00 00 31 c0 e9 8e 00 00 00 48 89 d8 48 c1 e8 03 80 3c 10 00 <74> 26 4c 89 0c 24 48 89 df 49 89 f5 4d 89 c6 e8 79 c4 69 00 4d 89 RSP: 0018:ffffc900034bef70 EFLAGS: 00000246 RAX: 1ffff92000697e14 RBX: ffffc900034bf0a0 RCX: ffffffff8fdb2000 RDX: dffffc0000000000 RSI: ffffffff81e23da6 RDI: ffffc900034bf0ac RBP: ffffc900034bf0a8 R08: 0000000000000004 R09: ffffc900034bf0b0 R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff92000697e15 R13: 1ffff92000697e15 R14: 0000000000000000 R15: 1ffff92000697e16 arch_stack_walk+0x101/0x140 arch/x86/kernel/stacktrace.c:27 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122 save_stack+0xf6/0x1e0 mm/page_owner.c:127 __reset_page_owner+0x52/0x1a0 mm/page_owner.c:148 reset_page_owner include/linux/page_owner.h:24 [inline] free_pages_prepare mm/page_alloc.c:1444 [inline] free_pcp_prepare mm/page_alloc.c:1494 [inline] free_unref_page_prepare+0xf63/0x1120 mm/page_alloc.c:3369 free_unref_page+0x33/0x3e0 mm/page_alloc.c:3464 free_slab mm/slub.c:2031 [inline] discard_slab mm/slub.c:2037 [inline] __unfreeze_partials+0x1b7/0x210 mm/slub.c:2586 put_cpu_partial+0x17b/0x250 mm/slub.c:2662 qlink_free mm/kasan/quarantine.c:168 [inline] qlist_free_all+0x76/0xe0 mm/kasan/quarantine.c:187 kasan_quarantine_reduce+0x156/0x170 mm/kasan/quarantine.c:294 __kasan_slab_alloc+0x1f/0x70 mm/kasan/common.c:305 kasan_slab_alloc include/linux/kasan.h:201 [inline] slab_post_alloc_hook+0x52/0x3a0 mm/slab.h:737 slab_alloc_node mm/slub.c:3398 [inline] __kmem_cache_alloc_node+0x137/0x260 mm/slub.c:3437 __do_kmalloc_node mm/slab_common.c:935 [inline] __kmalloc_node_track_caller+0xa0/0x220 mm/slab_common.c:956 kmalloc_reserve net/core/skbuff.c:446 [inline] __alloc_skb+0x135/0x670 net/core/skbuff.c:515 alloc_skb include/linux/skbuff.h:1271 [inline] alloc_skb_with_frags+0xa4/0x740 net/core/skbuff.c:6162 sock_alloc_send_pskb+0x915/0xa50 net/core/sock.c:2747 unix_dgram_sendmsg+0x5b1/0x2050 net/unix/af_unix.c:1918 sock_sendmsg_nosec net/socket.c:718 [inline] __sock_sendmsg net/socket.c:730 [inline] sock_write_iter+0x394/0x4e0 net/socket.c:1143 do_iter_write+0x6e6/0xc40 fs/read_write.c:861 vfs_writev fs/read_write.c:934 [inline] do_writev+0x27b/0x460 fs/read_write.c:977 do_syscall_x64 arch/x86/entry/common.c:51 [inline] do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:81 entry_SYSCALL_64_after_hwframe+0x68/0xd2 RIP: 0033:0x7f896b079e03 RSP: 002b:00007ffc64b2d2f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000014 RAX: ffffffffffffffda RBX: 00007ffc64b2d658 RCX: 00007f896b079e03 RDX: 0000000000000005 RSI: 00007ffc64b2d310 RDI: 000000000000000a RBP: 000000000000012c R08: 000000000000000a R09: 00007ffc64b2d350 R10: 00007ffc64b2d358 R11: 0000000000000246 R12: 00005618ee88e990 R13: 00005618ca492f88 R14: 00000000ffffffff R15: 0000000000000001 rcu: rcu_preempt kthread starved for 10549 jiffies! g29189 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:R running task stack:27064 pid:16 ppid:2 flags:0x00004000 Call Trace: context_switch kernel/sched/core.c:5241 [inline] __schedule+0x143f/0x4570 kernel/sched/core.c:6558 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6870 irqentry_exit+0x53/0x80 kernel/entry/common.c:439 asm_sysvec_reschedule_ipi+0x16/0x20 arch/x86/include/asm/idtentry.h:658 RIP: 0010:__free_object+0x9aa/0xa80 lib/debugobjects.c:415 Code: 84 24 80 00 00 00 42 80 3c 2b 00 74 08 4c 89 f7 e8 8b c7 a3 fd f6 84 24 81 00 00 00 02 75 5a f7 44 24 10 00 02 00 00 74 01 fb <48> c7 44 24 60 0e 36 e0 45 48 8b 44 24 40 49 c7 44 05 00 00 00 00 RSP: 0018:ffffc90000157980 EFLAGS: 00000206 RAX: fdffa0b7c2fc8d00 RBX: 1ffff9200002af44 RCX: ffffffff97333103 RDX: dffffc0000000000 RSI: ffffffff8b0c0340 RDI: ffffffff8b5d6dc0 RBP: ffffc90000157b58 R08: dffffc0000000000 R09: ffffc90000157a60 R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8880b8f37530 R13: dffffc0000000000 R14: ffffc90000157a20 R15: ffff8880b8f37528 free_object lib/debugobjects.c:423 [inline] debug_object_free+0x2c1/0x460 lib/debugobjects.c:855 destroy_timer_on_stack kernel/time/timer.c:812 [inline] schedule_timeout+0x1d0/0x300 kernel/time/timer.c:1969 rcu_gp_fqs_loop+0x2d2/0x1150 kernel/rcu/tree.c:1706 rcu_gp_kthread+0xa3/0x3b0 kernel/rcu/tree.c:1905 kthread+0x28d/0x320 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295 rcu: Stack dump where RCU GP kthread last ran: Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 skipped: idling at native_safe_halt arch/x86/include/asm/irqflags.h:51 [inline] NMI backtrace for cpu 1 skipped: idling at arch_safe_halt arch/x86/include/asm/irqflags.h:89 [inline] NMI backtrace for cpu 1 skipped: idling at acpi_safe_halt drivers/acpi/processor_idle.c:111 [inline] NMI backtrace for cpu 1 skipped: idling at acpi_idle_do_entry+0x10f/0x340 drivers/acpi/processor_idle.c:567