syzbot


INFO: rcu detected stall in perf_event_open (2)

Status: auto-closed as invalid on 2021/11/26 20:49
Subsystems: perf
[Documentation on labels]
First crash: 1218d, last: 1218d
Similar bugs (1)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in perf_event_open kernel 1 1315d 1315d 0/28 auto-closed as invalid on 2021/09/21 01:14

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	0-...!: (1 GPs behind) idle=38d/1/0x4000000000000000 softirq=139469/139470 fqs=18 
	(t=10500 jiffies g=260673 q=1768)
rcu: rcu_preempt kthread starved for 10455 jiffies! g260673 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:28696 pid:   14 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:4955 [inline]
 __schedule+0x940/0x26f0 kernel/sched/core.c:6236
 schedule+0xd3/0x270 kernel/sched/core.c:6315
 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1881
 rcu_gp_fqs_loop+0x186/0x810 kernel/rcu/tree.c:1959
 rcu_gp_kthread+0x1de/0x320 kernel/rcu/tree.c:2132
 kthread+0x405/0x4f0 kernel/kthread.c:327
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 27244 Comm: syz-executor.3 Not tainted 5.15.0-rc3-next-20210927-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:kasan_quarantine_put+0x4/0x210 mm/kasan/quarantine.c:172
Code: df e8 e0 fe ff ff 48 89 ee 48 89 e7 e8 e5 fd ff ff 48 83 c4 20 5b 5d c3 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 41 56 41 55 <41> 54 49 89 fc 55 53 e8 30 d8 ff ff 48 85 c0 0f 84 c4 00 00 00 48
RSP: 0018:ffffc90000dc09f8 EFLAGS: 00000282
RAX: dffffc0000000000 RBX: ffffc90000dc0a88 RCX: 0000000000000001
RDX: 00000000000f6066 RSI: ffff88815023ec00 RDI: ffff888010c41c80
RBP: ffff888010c41c80 R08: 000000003d06546d R09: 0000000083e8c19f
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000000
R13: ffff88815023ec00 R14: ffffc90000dc0a90 R15: ffff88815023ec00
FS:  00007fa75f9b4700(0000) GS:ffff8880b9d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa75f9b4718 CR3: 000000014f81a000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 kasan_slab_free include/linux/kasan.h:230 [inline]
 slab_free_hook mm/slub.c:1700 [inline]
 slab_free_freelist_hook+0x8b/0x1c0 mm/slub.c:1726
 slab_free mm/slub.c:3492 [inline]
 kfree+0xf6/0x560 mm/slub.c:4538
 skb_free_head net/core/skbuff.c:653 [inline]
 skb_release_data+0x65a/0x790 net/core/skbuff.c:675
 skb_release_all net/core/skbuff.c:740 [inline]
 __kfree_skb net/core/skbuff.c:754 [inline]
 kfree_skb net/core/skbuff.c:772 [inline]
 kfree_skb+0x133/0x3f0 net/core/skbuff.c:766
 __netif_receive_skb_core+0x54f/0x3640 net/core/dev.c:5412
 __netif_receive_skb_one_core+0xae/0x180 net/core/dev.c:5436
 __netif_receive_skb+0x24/0x1b0 net/core/dev.c:5552
 process_backlog+0x2a5/0x6c0 net/core/dev.c:6429
 __napi_poll+0xaf/0x440 net/core/dev.c:6988
 napi_poll net/core/dev.c:7055 [inline]
 net_rx_action+0x801/0xb40 net/core/dev.c:7142
 __do_softirq+0x29b/0x9c2 kernel/softirq.c:558
 invoke_softirq kernel/softirq.c:432 [inline]
 __irq_exit_rcu+0x123/0x180 kernel/softirq.c:637
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:649
 sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1097
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:lock_release+0x3f1/0x720 kernel/locking/lockdep.c:5633
Code: 7e 83 f8 01 0f 85 8d 01 00 00 9c 58 f6 c4 02 0f 85 78 01 00 00 48 f7 04 24 00 02 00 00 74 01 fb 48 b8 00 00 00 00 00 fc ff df <48> 01 c5 48 c7 45 00 00 00 00 00 c7 45 08 00 00 00 00 48 8b 84 24
RSP: 0018:ffffc9000d65fbe0 EFLAGS: 00000206
RAX: dffffc0000000000 RBX: 5a86ab0430a2a1fc RCX: ffffc9000d65fc30
RDX: 1ffff1101689e4eb RSI: 0000000000000000 RDI: 0000000000000000
RBP: 1ffff92001acbf7e R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
R13: 0000000000000002 R14: ffff8880b44f2760 R15: ffff8880b44f1d00
 __mutex_unlock_slowpath+0x99/0x5e0 kernel/locking/mutex.c:892
 __do_sys_perf_event_open+0x1d39/0x3130 kernel/events/core.c:12358
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7fa76245e709
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fa75f9b4188 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 00007fa762563020 RCX: 00007fa76245e709
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000000020000500
RBP: 00007fa7624b8cb4 R08: 0000000000000000 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffce7f0c6af R14: 00007fa75f9b4300 R15: 0000000000022000
 </TASK>
NMI backtrace for cpu 0
CPU: 0 PID: 27234 Comm: syz-executor.3 Not tainted 5.15.0-rc3-next-20210927-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:105
 nmi_trigger_cpumask_backtrace+0x1ae/0x220 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x25e/0x3f0 kernel/rcu/tree_stall.h:343
 print_cpu_stall kernel/rcu/tree_stall.h:627 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:711 [inline]
 rcu_pending kernel/rcu/tree.c:3882 [inline]
 rcu_sched_clock_irq.cold+0x9d/0x746 kernel/rcu/tree.c:2601
 update_process_times+0x16d/0x200 kernel/time/timer.c:1785
 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:226
 tick_sched_timer+0x1b0/0x2d0 kernel/time/tick-sched.c:1428
 __run_hrtimer kernel/time/hrtimer.c:1685 [inline]
 __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103
 sysvec_apic_timer_interrupt+0x40/0xc0 arch/x86/kernel/apic/apic.c:1097
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:task_stack_page include/linux/sched/task_stack.h:21 [inline]
RIP: 0010:in_task_stack+0x0/0x40 arch/x86/kernel/dumpstack.c:35
Code: 41 5d e9 63 00 00 00 4c 89 ee 48 c7 c7 80 88 79 8b e8 24 55 be fa e9 5c ff ff ff cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc <48> 8b 46 20 48 8d 88 00 80 00 00 48 39 f8 77 21 48 39 f9 76 1c 48
RSP: 0018:ffffc90000007660 EFLAGS: 00000286
RAX: dffffc0000000000 RBX: ffff888071773a00 RCX: ffffc90000007728
RDX: ffffc90000007708 RSI: ffff888071773a00 RDI: ffffc900000076b8
RBP: ffffc90000007708 R08: 0000000000000001 R09: ffffc90000007708
R10: fffff52000000eec R11: 0000000000000000 R12: ffffc900000076b8
R13: ffffc90000007708 R14: ffffc90000007740 R15: ffffc90000007708
 get_stack_info_noinstr+0x14/0x120 arch/x86/kernel/dumpstack_64.c:173
 get_stack_info+0x2d/0x90 arch/x86/kernel/dumpstack_64.c:199
 __unwind_start+0x4ae/0x800 arch/x86/kernel/unwind_orc.c:668
 unwind_start arch/x86/include/asm/unwind.h:60 [inline]
 arch_stack_walk+0x5c/0xe0 arch/x86/kernel/stacktrace.c:24
 stack_trace_save+0x8c/0xc0 kernel/stacktrace.c:121
 kasan_save_stack+0x1e/0x50 mm/kasan/common.c:38
 kasan_set_track mm/kasan/common.c:46 [inline]
 set_alloc_info mm/kasan/common.c:434 [inline]
 __kasan_slab_alloc+0x90/0xc0 mm/kasan/common.c:467
 kasan_slab_alloc include/linux/kasan.h:254 [inline]
 slab_post_alloc_hook mm/slab.h:519 [inline]
 slab_alloc_node mm/slub.c:3213 [inline]
 slab_alloc mm/slub.c:3221 [inline]
 kmem_cache_alloc+0x209/0x390 mm/slub.c:3226
 skb_clone+0x170/0x3c0 net/core/skbuff.c:1519
 hsr_create_tagged_frame+0x173/0xb60 net/hsr/hsr_forward.c:251
 hsr_forward_do net/hsr/hsr_forward.c:417 [inline]
 hsr_forward_skb+0x84c/0x1620 net/hsr/hsr_forward.c:578
 send_hsr_supervision_frame+0x60b/0x8d0 net/hsr/hsr_device.c:324
 hsr_announce+0x109/0x330 net/hsr/hsr_device.c:382
 call_timer_fn+0x1a5/0x6b0 kernel/time/timer.c:1421
 expire_timers kernel/time/timer.c:1466 [inline]
 __run_timers.part.0+0x675/0xa20 kernel/time/timer.c:1734
 __run_timers kernel/time/timer.c:1715 [inline]
 run_timer_softirq+0xb3/0x1d0 kernel/time/timer.c:1747
 __do_softirq+0x29b/0x9c2 kernel/softirq.c:558
 invoke_softirq kernel/softirq.c:432 [inline]
 __irq_exit_rcu+0x123/0x180 kernel/softirq.c:637
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:649
 sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1097
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:check_kcov_mode+0x7/0x40 kernel/kcov.c:163
Code: 00 e9 59 fe ff ff 48 8b 7c 24 08 e8 a3 4d 46 00 e9 61 fd ff ff cc cc cc cc cc cc cc cc cc cc cc cc cc cc 65 8b 05 a9 36 8c 7e <89> c2 81 e2 00 01 00 00 a9 00 01 ff 00 74 10 31 c0 85 d2 74 15 8b
RSP: 0018:ffffc9000d547a28 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000000000000000b RCX: ffff888071773a00
RDX: 0000000000040000 RSI: ffff888071773a00 RDI: 0000000000000003
RBP: ffff888072b01500 R08: 0000000000000000 R09: 000000000000000b
R10: ffffffff839fb41a R11: 0000000000000010 R12: 0000000000000010
R13: 000000000000009f R14: dffffc0000000000 R15: 0000000000000000
 write_comp_data kernel/kcov.c:218 [inline]
 __sanitizer_cov_trace_const_cmp1+0x22/0x80 kernel/kcov.c:270
 tomoyo_domain_quota_is_ok+0x32a/0x550 security/tomoyo/util.c:1092
 tomoyo_supervisor+0x2f2/0xf00 security/tomoyo/common.c:2089
 tomoyo_audit_path_number_log security/tomoyo/file.c:235 [inline]
 tomoyo_path_number_perm+0x419/0x590 security/tomoyo/file.c:734
 security_file_ioctl+0x50/0xb0 security/security.c:1540
 __do_sys_ioctl fs/ioctl.c:868 [inline]
 __se_sys_ioctl fs/ioctl.c:860 [inline]
 __x64_sys_ioctl+0xb3/0x200 fs/ioctl.c:860
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7fa76245e709
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fa75f9d5188 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
RAX: ffffffffffffffda RBX: 00007fa762562f60 RCX: 00007fa76245e709
RDX: 000000002004dd80 RSI: 00000000d000943d RDI: 0000000000000003
RBP: 00007fa7624b8cb4 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffce7f0c6af R14: 00007fa75f9d5300 R15: 0000000000022000
 </TASK>
----------------
Code disassembly (best guess), 1 bytes skipped:
   0:	e8 e0 fe ff ff       	callq  0xfffffee5
   5:	48 89 ee             	mov    %rbp,%rsi
   8:	48 89 e7             	mov    %rsp,%rdi
   b:	e8 e5 fd ff ff       	callq  0xfffffdf5
  10:	48 83 c4 20          	add    $0x20,%rsp
  14:	5b                   	pop    %rbx
  15:	5d                   	pop    %rbp
  16:	c3                   	retq
  17:	66 66 2e 0f 1f 84 00 	data16 nopw %cs:0x0(%rax,%rax,1)
  1e:	00 00 00 00
  22:	0f 1f 00             	nopl   (%rax)
  25:	41 56                	push   %r14
  27:	41 55                	push   %r13
* 29:	41 54                	push   %r12 <-- trapping instruction
  2b:	49 89 fc             	mov    %rdi,%r12
  2e:	55                   	push   %rbp
  2f:	53                   	push   %rbx
  30:	e8 30 d8 ff ff       	callq  0xffffd865
  35:	48 85 c0             	test   %rax,%rax
  38:	0f 84 c4 00 00 00    	je     0x102
  3e:	48                   	rex.W

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2021/09/27 20:40 linux-next bf5b1e621a51 78494d16 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in perf_event_open
* Struck through repros no longer work on HEAD.