INFO: rcu detected stall in do_huge_pmd_anonymous_page

Status: closed as invalid on 2019/12/04 14:14
Subsystems: bpf
[Documentation on labels]
First crash: 2458d, last: 2456d
▶ ▼ Similar bugs (3)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in do_huge_pmd_anonymous_page (3) mm 1 10 2421d 2421d 0/29 closed as invalid on 2020/01/09 08:13
upstream INFO: rcu detected stall in do_huge_pmd_anonymous_page (2) cgroups mm 1 4 2421d 2422d 0/29 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in do_huge_pmd_anonymous_page (4) mm 1 1 2151d 2151d 0/29 auto-closed as invalid on 2021/01/02 10:18

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-...!: (1 GPs behind) idle=65a/1/0x4000000000000002 softirq=11095/11096 fqs=135 
	(t=10500 jiffies g=6853 q=359)
rcu: rcu_preempt kthread starved for 10206 jiffies! g6853 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: RCU grace-period kthread stack dump:
rcu_preempt     R  running task    29032    10      2 0x80004000
Call Trace:
 context_switch kernel/sched/core.c:3385 [inline]
 __schedule+0x9a0/0xcc0 kernel/sched/core.c:4081
 schedule+0x181/0x210 kernel/sched/core.c:4155
 schedule_timeout+0x14f/0x240 kernel/time/timer.c:1895
 rcu_gp_fqs_loop kernel/rcu/tree.c:1661 [inline]
 rcu_gp_kthread+0xed8/0x1770 kernel/rcu/tree.c:1821
 kthread+0x332/0x350 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352
NMI backtrace for cpu 1
CPU: 1 PID: 8430 Comm: syz-executor.0 Not tainted 5.4.0-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x1fb/0x318 lib/dump_stack.c:118
 nmi_cpu_backtrace+0xaf/0x1a0 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x174/0x290 lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x10/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x15a/0x220 kernel/rcu/tree_stall.h:254
 print_cpu_stall kernel/rcu/tree_stall.h:455 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:529 [inline]
 rcu_pending kernel/rcu/tree.c:2827 [inline]
 rcu_sched_clock_irq+0xe25/0x1ad0 kernel/rcu/tree.c:2271
 update_process_times+0x12d/0x180 kernel/time/timer.c:1726
 tick_sched_handle kernel/time/tick-sched.c:167 [inline]
 tick_sched_timer+0x263/0x420 kernel/time/tick-sched.c:1310
 __run_hrtimer kernel/time/hrtimer.c:1517 [inline]
 __hrtimer_run_queues+0x403/0x840 kernel/time/hrtimer.c:1579
 hrtimer_interrupt+0x38c/0xda0 kernel/time/hrtimer.c:1641
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
 smp_apic_timer_interrupt+0x109/0x280 arch/x86/kernel/apic/apic.c:1135
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
 </IRQ>
RIP: 0010:mod_memcg_page_state+0xe/0x190 include/linux/memcontrol.h:652
Code: 00 eb 05 e8 84 26 2e 00 48 83 c4 10 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 54 53 41 89 f6 <48> 89 fb e8 5a 26 2e 00 48 83 c3 38 48 89 d8 48 c1 e8 03 49 bc 00
RSP: 0018:ffffc9000290ed48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 1ffff1101366e2f1 RBX: ffff88809b371788 RCX: 0000000000000000
RDX: ffffc90001f91000 RSI: 00000000fffffffc RDI: ffffea00024547c0
RBP: ffffc9000290ed68 R08: 000000000003a728 R09: ffffed10123c672f
R10: ffffed10123c672f R11: 0000000000000000 R12: ffff88809b371820
R13: dffffc0000000000 R14: 00000000fffffffc R15: ffff888091e33968
 free_thread_stack+0x168/0x590 kernel/fork.c:280
 release_task_stack kernel/fork.c:440 [inline]
 put_task_stack+0xa3/0x130 kernel/fork.c:451
 finish_task_switch+0x3f1/0x550 kernel/sched/core.c:3256
 context_switch kernel/sched/core.c:3388 [inline]
 __schedule+0x9a8/0xcc0 kernel/sched/core.c:4081
 preempt_schedule_common kernel/sched/core.c:4236 [inline]
 preempt_schedule+0xdb/0x120 kernel/sched/core.c:4261
 ___preempt_schedule+0x16/0x18 arch/x86/entry/thunk_64.S:50
 __kunmap_atomic include/linux/highmem.h:102 [inline]
 clear_highpage include/linux/highmem.h:215 [inline]
 kernel_init_free_pages mm/page_alloc.c:1125 [inline]
 prep_new_page+0x161/0x2e0 mm/page_alloc.c:2171
 get_page_from_freelist+0x850/0xaa0 mm/page_alloc.c:3695
 __alloc_pages_nodemask+0x264/0x5d0 mm/page_alloc.c:4756
 __alloc_pages include/linux/gfp.h:496 [inline]
 __alloc_pages_node include/linux/gfp.h:509 [inline]
 alloc_pages_vma+0x94a/0xd50 mm/mempolicy.c:2151
 do_huge_pmd_anonymous_page+0x883/0xe50 mm/huge_memory.c:758
 create_huge_pmd mm/memory.c:3836 [inline]
 __handle_mm_fault mm/memory.c:4046 [inline]
 handle_mm_fault+0x2017/0x2890 mm/memory.c:4112
 do_user_addr_fault+0x589/0xaf0 arch/x86/mm/fault.c:1441
 __do_page_fault+0xd3/0x1f0 arch/x86/mm/fault.c:1506
 do_page_fault+0x99/0xb0 arch/x86/mm/fault.c:1530
 page_fault+0x39/0x40 arch/x86/entry/entry_64.S:1203
RIP: 0010:copy_user_generic_unrolled+0x89/0xc0 arch/x86/lib/copy_user_64.S:91
Code: 38 4c 89 47 20 4c 89 4f 28 4c 89 57 30 4c 89 5f 38 48 8d 76 40 48 8d 7f 40 ff c9 75 b6 89 d1 83 e2 07 c1 e9 03 74 12 4c 8b 06 <4c> 89 07 48 8d 76 08 48 8d 7f 08 ff c9 75 ee 21 d2 74 10 89 d1 8a
RSP: 0018:ffffc9000290f4f0 EFLAGS: 00010203
RAX: ffffffff838f8d01 RBX: 000000002062b00d RCX: 0000000000000001
RDX: 0000000000000005 RSI: ffff88809fb78264 RDI: 000000002062b000
RBP: ffffc9000290f520 R08: 6461657221203352 R09: ffffed1013f6f04f
R10: ffffed1013f6f04f R11: 0000000000000000 R12: 000000000000000d
R13: 00007ffffffff000 R14: ffff88809fb78264 R15: 000000002062b000
 copy_to_user include/linux/uaccess.h:152 [inline]
 bpf_verifier_vlog+0x18b/0x2f0 kernel/bpf/verifier.c:279
 verbose+0x173/0x200 kernel/bpf/verifier.c:312
 check_reg_arg+0x42c/0xb20 kernel/bpf/verifier.c:1443
 check_func_arg kernel/bpf/verifier.c:3415 [inline]
 check_helper_call kernel/bpf/verifier.c:4227 [inline]
 do_check+0x90f4/0x1c4d0 kernel/bpf/verifier.c:7967
 bpf_check+0xd9a8/0xfc40 kernel/bpf/verifier.c:9772
 bpf_prog_load kernel/bpf/syscall.c:1805 [inline]
 __do_sys_bpf+0x99d6/0xc890 kernel/bpf/syscall.c:3030
 __se_sys_bpf kernel/bpf/syscall.c:2989 [inline]
 __x64_sys_bpf+0x7a/0x90 kernel/bpf/syscall.c:2989
 do_syscall_64+0xf7/0x1c0 arch/x86/entry/common.c:294
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x45a679
Code: ad b6 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 7b b6 fb ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007fbcac0cdc78 EFLAGS: 00000246 ORIG_RAX: 0000000000000141
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 000000000045a679
RDX: 0000000000000070 RSI: 0000000020000040 RDI: 0000000000000005
RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fbcac0ce6d4
R13: 00000000004c0d07 R14: 00000000004d4828 R15: 00000000ffffffff

Crashes (31):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/12/04 11:55 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 09:56 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 09:23 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 06:32 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 03:01 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 01:23 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 23:51 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 22:06 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 21:44 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:51 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:27 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 19:38 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 19:38 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 19:04 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 18:35 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 18:03 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 17:16 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 14:44 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 13:51 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 13:30 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 12:00 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 10:24 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 09:47 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 09:17 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 05:57 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:44 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 03:11 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 23:55 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 21:58 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 21:36 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 20:26 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
* Struck through repros no longer work on HEAD.