INFO: rcu detected stall in seq

Kernel	Title	Repro	Cause bisect	Fix bisect	Count	Last	Reported	Patched	Status
upstream	INFO: rcu detected stall in seq_read (2) fs	C	done	error	5	780d	1367d	0/26	upstream: reported C repro on 2020/07/22 18:02

rcu: INFO: rcu_preempt self-detected stall on CPU rcu: 1-...!: (1 GPs behind) idle=ff6/1/0x4000000000000004 softirq=321048/321049 fqs=0 (t=10501 jiffies g=427429 q=55) rcu: rcu_preempt kthread starved for 10502 jiffies! g427429 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 rcu: RCU grace-period kthread stack dump: rcu_preempt R running task 28736 10 2 0x80004000 Call Trace: context_switch kernel/sched/core.c:3384 [inline] __schedule+0x82e/0xc50 kernel/sched/core.c:4056 schedule+0x131/0x1e0 kernel/sched/core.c:4123 schedule_timeout+0x14f/0x240 kernel/time/timer.c:1893 rcu_gp_fqs_loop kernel/rcu/tree.c:1639 [inline] rcu_gp_kthread+0xef8/0x1790 kernel/rcu/tree.c:1799 kthread+0x332/0x350 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 5620 Comm: syz-executor.2 Not tainted 5.3.0+ #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 RIP: 0010:mark_lock+0x157/0x1650 kernel/locking/lockdep.c:3643 Code: 08 00 0f 84 55 07 00 00 31 db eb 0e 48 69 c3 b0 00 00 00 48 8d 98 d0 54 1c 89 48 83 c3 50 48 89 d8 48 c1 e8 03 42 80 3c 28 00 <74> 08 48 89 df e8 0f 92 53 00 44 85 3b 74 2f 41 bd 01 00 00 00 65 RSP: 0018:ffff8880aea09a60 EFLAGS: 00000046 RAX: 1ffffffff1239de4 RBX: ffffffff891cef20 RCX: ffffffff8158ef47 RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff895d74f8 RBP: ffff8880aea09b58 R08: dffffc0000000000 R09: fffffbfff12baea0 R10: fffffbfff12baea0 R11: 0000000000000000 R12: 1ffff1101158f5ec R13: dffffc0000000000 R14: 0000000000000002 R15: 0000000000000004 FS: 00007fe590159700(0000) GS:ffff8880aea00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000004c5ef0 CR3: 000000003c993000 CR4: 00000000001426f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: <IRQ> mark_held_locks kernel/locking/lockdep.c:3360 [inline] __trace_hardirqs_on_caller kernel/locking/lockdep.c:3381 [inline] lockdep_hardirqs_on+0x295/0x7d0 kernel/locking/lockdep.c:3434 trace_hardirqs_on+0x74/0x80 kernel/trace/trace_preemptirq.c:31 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline] _raw_spin_unlock_irqrestore+0x77/0xe0 kernel/locking/spinlock.c:191 __mod_timer+0xf01/0x1590 kernel/time/timer.c:1057 mod_timer+0x1f/0x30 kernel/time/timer.c:1100 pie_timer+0x6c4/0x7d0 net/sched/sch_pie.c:454 call_timer_fn+0x95/0x170 kernel/time/timer.c:1404 expire_timers kernel/time/timer.c:1449 [inline] __run_timers+0x7a6/0x9a0 kernel/time/timer.c:1771 run_timer_softirq+0x4a/0x90 kernel/time/timer.c:1784 __do_softirq+0x333/0x7c4 arch/x86/include/asm/paravirt.h:766 invoke_softirq kernel/softirq.c:373 [inline] irq_exit+0x227/0x230 kernel/softirq.c:413 exiting_irq arch/x86/include/asm/apic.h:536 [inline] smp_apic_timer_interrupt+0x113/0x280 arch/x86/kernel/apic/apic.c:1137 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:830 </IRQ> RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:756 [inline] RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline] RIP: 0010:_raw_spin_unlock_irqrestore+0xad/0xe0 kernel/locking/spinlock.c:191 Code: b9 00 00 00 00 00 fc ff df 80 3c 08 00 74 0c 48 c7 c7 b0 8b 8a 88 e8 a2 98 3d fa 48 83 3d 9a a2 1b 01 00 74 2d 4c 89 f7 57 9d <0f> 1f 44 00 00 bf 01 00 00 00 e8 b4 2b e1 f9 65 8b 05 99 14 93 78 RSP: 0018:ffff88802602fa08 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13 RAX: 1ffffffff1115176 RBX: ffff888022a8ce98 RCX: dffffc0000000000 RDX: 0000000000000000 RSI: 0000000000000008 RDI: 0000000000000286 RBP: ffff88802602fa18 R08: ffff88808ac7aed8 R09: fffffbfff12baea0 R10: fffffbfff12baea0 R11: 0000000000000000 R12: 1ffff110045518df R13: ffff888022a8c6f8 R14: 0000000000000286 R15: ffff888022a8c6d0 task_rq_unlock kernel/sched/sched.h:1188 [inline] wait_task_inactive+0x2a7/0x490 kernel/sched/core.c:1936 task_current_syscall+0x6a/0x110 lib/syscall.c:74 proc_pid_syscall+0xa1/0x3a0 fs/proc/base.c:639 proc_single_show+0xd8/0x120 fs/proc/base.c:756 seq_read+0x4cd/0xd70 fs/seq_file.c:229 do_loop_readv_writev fs/read_write.c:714 [inline] do_iter_read+0x4b1/0x5b0 fs/read_write.c:935 vfs_readv fs/read_write.c:997 [inline] do_preadv+0x178/0x290 fs/read_write.c:1089 __do_sys_preadv fs/read_write.c:1139 [inline] __se_sys_preadv fs/read_write.c:1134 [inline] __x64_sys_preadv+0x9e/0xb0 fs/read_write.c:1134 do_syscall_64+0xf7/0x1c0 arch/x86/entry/common.c:290 entry_SYSCALL_64_after_hwframe+0x49/0xbe RIP: 0033:0x4598e9 Code: fd b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 cb b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 RSP: 002b:00007fe590158c78 EFLAGS: 00000246 ORIG_RAX: 0000000000000127 RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00000000004598e9 RDX: 0000000000000333 RSI: 00000000200017c0 RDI: 0000000000000005 RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007fe5901596d4 R13: 00000000004c6bd1 R14: 00000000004dbf40 R15: 00000000ffffffff NMI backtrace for cpu 1 CPU: 1 PID: 5623 Comm: syz-executor.5 Not tainted 5.3.0+ #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: <IRQ> __dump_stack lib/dump_stack.c:77 [inline] dump_stack+0x1d8/0x2f8 lib/dump_stack.c:113 nmi_cpu_backtrace+0xaf/0x1a0 lib/nmi_backtrace.c:101 nmi_trigger_cpumask_backtrace+0x174/0x290 lib/nmi_backtrace.c:62 arch_trigger_cpumask_backtrace+0x10/0x20 arch/x86/kernel/apic/hw_nmi.c:38 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_dump_cpu_stacks+0x15a/0x220 kernel/rcu/tree_stall.h:254 print_cpu_stall kernel/rcu/tree_stall.h:455 [inline] check_cpu_stall kernel/rcu/tree_stall.h:529 [inline] rcu_pending kernel/rcu/tree.c:2795 [inline] rcu_sched_clock_irq+0xe22/0x1ae0 kernel/rcu/tree.c:2244 update_process_times+0x12d/0x180 kernel/time/timer.c:1724 tick_sched_handle kernel/time/tick-sched.c:167 [inline] tick_sched_timer+0x263/0x420 kernel/time/tick-sched.c:1299 __run_hrtimer kernel/time/hrtimer.c:1514 [inline] __hrtimer_run_queues+0x403/0x850 kernel/time/hrtimer.c:1576 hrtimer_interrupt+0x38c/0xda0 kernel/time/hrtimer.c:1638 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline] smp_apic_timer_interrupt+0x109/0x280 arch/x86/kernel/apic/apic.c:1135 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:830 RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:756 [inline] RIP: 0010:lock_acquire+0x1b2/0x250 kernel/locking/lockdep.c:4490 Code: c1 e8 03 42 80 3c 30 00 74 0c 48 c7 c7 b0 8b 8a 88 e8 f2 03 54 00 48 83 3d ea 0d 32 07 00 0f 84 9c 00 00 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 48 83 c4 30 5b 41 5c 41 5d 41 5e 41 5f 5d c3 44 89 RSP: 0018:ffff8880aeb09c38 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13 RAX: 1ffffffff1115176 RBX: 0000000000000000 RCX: ffffffff81595592 RDX: dffffc0000000000 RSI: 0000000000000008 RDI: 0000000000000286 RBP: ffff8880aeb09c90 R08: dffffc0000000000 R09: fffffbfff12baeb3 R10: fffffbfff12baeb3 R11: 0000000000000000 R12: 0000000000000001 R13: 0000000000000000 R14: dffffc0000000000 R15: ffff8880a8bb8ec0 __raw_spin_lock include/linux/spinlock_api_smp.h:142 [inline] _raw_spin_lock+0x2d/0x40 kernel/locking/spinlock.c:151 spin_lock include/linux/spinlock.h:338 [inline] pie_timer+0x88/0x7d0 net/sched/sch_pie.c:449 call_timer_fn+0x95/0x170 kernel/time/timer.c:1404 expire_timers kernel/time/timer.c:1449 [inline] __run_timers+0x7a6/0x9a0 kernel/time/timer.c:1771 run_timer_softirq+0x4a/0x90 kernel/time/timer.c:1784 __do_softirq+0x333/0x7c4 arch/x86/include/asm/paravirt.h:766 invoke_softirq kernel/softirq.c:373 [inline] irq_exit+0x227/0x230 kernel/softirq.c:413 exiting_irq arch/x86/include/asm/apic.h:536 [inline] smp_apic_timer_interrupt+0x113/0x280 arch/x86/kernel/apic/apic.c:1137 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:830 </IRQ> RIP: 0010:perf_trace_init+0x17a/0x220 kernel/trace/trace_event_perf.c:219 Code: 17 f9 ff 0f 1f 00 66 2e 0f 1f 84 00 00 00 00 00 4c 89 e8 48 c1 e8 03 42 80 3c 30 00 74 08 4c 89 ef e8 1a 58 32 00 4d 8b 6d 00 <4d> 39 e5 0f 85 0d ff ff ff eb 1d 89 d9 80 e1 07 80 c1 03 38 c1 0f RSP: 0018:ffff888024a9fbb0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13 RAX: 1ffffffff116a3b6 RBX: 0000000000000827 RCX: 0000000000040000 RDX: ffffc900109d2000 RSI: 0000000000001f6f RDI: 0000000000001f70 RBP: ffff888024a9fbe0 R08: ffffffff817a28db R09: fffffbfff111ccd3 R10: fffffbfff111ccd3 R11: 0000000000000000 R12: ffffffff888e6710 R13: ffffffff88b51c80 R14: dffffc0000000000 R15: 00000000000002b9 perf_tp_event_init+0x8b/0x110 kernel/events/core.c:8747 perf_try_init_event+0x14e/0x3c0 kernel/events/core.c:10184 perf_init_event kernel/events/core.c:10235 [inline] perf_event_alloc+0xfd1/0x24f0 kernel/events/core.c:10505 __do_sys_perf_event_open kernel/events/core.c:10982 [inline] __se_sys_perf_event_open+0x5b7/0x3ab0 kernel/events/core.c:10871 __x64_sys_perf_event_open+0xbf/0xd0 kernel/events/core.c:10871 do_syscall_64+0xf7/0x1c0 arch/x86/entry/common.c:290 entry_SYSCALL_64_after_hwframe+0x49/0xbe RIP: 0033:0x4598e9 Code: fd b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 cb b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 RSP: 002b:00007efe03094c78 EFLAGS: 00000246 ORIG_RAX: 000000000000012a RAX: ffffffffffffffda RBX: 0000000000000005 RCX: 00000000004598e9 RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000000020000440 RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000 R10: ffffffffffffffff R11: 0000000000000246 R12: 00007efe030956d4 R13: 00000000004c671d R14: 00000000004db910 R15: 00000000ffffffff