syzbot


BUG: soft lockup in fq_pie_timer

Status: fixed on 2023/07/22 07:09
Reported-by: syzbot+0f435c2ca38c42c73d4e@syzkaller.appspotmail.com
Fix commit: 1d37434ffc13 net/sched: fq_pie: ensure reasonable TCA_FQ_PIE_QUANTUM values
First crash: 559d, last: 551d
Fix bisection: fixed by (bisect log) :
commit 1d37434ffc1376306167dc61f37f78da18455b74
Author: Eric Dumazet <edumazet@google.com>
Date: Fri Jun 2 12:37:47 2023 +0000

  net/sched: fq_pie: ensure reasonable TCA_FQ_PIE_QUANTUM values

  
Bug presence (1)
Date Name Commit Repro Result
2023/07/18 upstream (ToT) fdf0eaf11452 C Didn't crash
Similar bugs (7)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 BUG: soft lockup in fq_pie_timer (2) origin:upstream C inconclusive 5 237d 472d 0/3 upstream: reported C repro on 2023/08/29 01:49
upstream INFO: rcu detected stall in fq_pie_timer (2) net C done 34 19d 351d 0/28 upstream: reported C repro on 2023/12/27 13:54
upstream BUG: soft lockup in fq_pie_timer (4) net syz 5 458d 508d 23/28 fixed on 2023/10/12 12:48
upstream INFO: rcu detected stall in fq_pie_timer net C error 35 1051d 1269d 20/28 fixed on 2022/03/08 16:11
linux-5.15 INFO: rcu detected stall in fq_pie_timer C done 23 479d 570d 0/3 auto-obsoleted due to no activity on 2024/10/31 18:20
upstream BUG: soft lockup in fq_pie_timer (2) net C error done 3 597d 663d 0/28 closed as invalid on 2023/05/26 05:46
upstream BUG: soft lockup in fq_pie_timer net C error error 10 793d 830d 0/28 closed as invalid on 2022/11/18 11:06

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [swapper/0:0]
Modules linked in:
irq event stamp: 183737
hardirqs last  enabled at (183736): [<ffff800012104ed0>] __el1_irq arch/arm64/kernel/entry-common.c:476 [inline]
hardirqs last  enabled at (183736): [<ffff800012104ed0>] el1_interrupt+0x58/0x68 arch/arm64/kernel/entry-common.c:486
hardirqs last disabled at (183737): [<ffff800012104e9c>] __el1_irq arch/arm64/kernel/entry-common.c:468 [inline]
hardirqs last disabled at (183737): [<ffff800012104e9c>] el1_interrupt+0x24/0x68 arch/arm64/kernel/entry-common.c:486
softirqs last  enabled at (178442): [<ffff800008020d74>] softirq_handle_end kernel/softirq.c:414 [inline]
softirqs last  enabled at (178442): [<ffff800008020d74>] __do_softirq+0xc14/0xea0 kernel/softirq.c:600
softirqs last disabled at (178557): [<ffff80000802a994>] ____do_softirq+0x14/0x20 arch/arm64/kernel/irq.c:79
CPU: 0 PID: 0 Comm: swapper/0 Not tainted 6.1.32-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 05/25/2023
pstate: 00400005 (nzcv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
pc : queued_spin_lock_slowpath+0x15c/0xe48 kernel/locking/qspinlock.c:383
lr : queued_spin_lock_slowpath+0x168/0xe48 kernel/locking/qspinlock.c:383
sp : ffff8000080079c0
x29: ffff800008007a60 x28: 1fffe0001a24581e x27: 1ffff00001000f44
x26: dfff800000000000 x25: 1fffe0001a245820 x24: ffff8000080079e0
x23: ffff800008007a20 x22: ffff700001000f3c x21: 0000000000000001
x20: 0000000000000001 x19: ffff0000d122c0f0 x18: ffff8000080078c0
x17: ffff80019f09e000 x16: ffff80000896d2d4 x15: 000000000000d88c
x14: 00000000d9015e62 x13: dfff800000000000 x12: 0000000000000001
x11: 1fffe0001a24581e x10: 0000000000000000 x9 : 0000000000000000
x8 : 0000000000000101 x7 : 0000000000000000 x6 : 0000000000000000
x5 : ffff800018789298 x4 : 0000000000000008 x3 : ffff8000121e8bf4
x2 : 0000000000000000 x1 : 0000000000000004 x0 : 0000000000000001
Call trace:
 __cmpwait_case_32 arch/arm64/include/asm/cmpxchg.h:252 [inline]
 __cmpwait arch/arm64/include/asm/cmpxchg.h:278 [inline]
 queued_spin_lock_slowpath+0x15c/0xe48 kernel/locking/qspinlock.c:383
 queued_spin_lock include/asm-generic/qspinlock.h:114 [inline]
 do_raw_spin_lock+0x330/0x358 kernel/locking/spinlock_debug.c:115
 __raw_spin_lock include/linux/spinlock_api_smp.h:134 [inline]
 _raw_spin_lock+0x5c/0x6c kernel/locking/spinlock.c:154
 spin_lock include/linux/spinlock.h:350 [inline]
 fq_pie_timer+0x94/0x248 net/sched/sch_fq_pie.c:377
 call_timer_fn+0x1c0/0xa1c kernel/time/timer.c:1474
 expire_timers kernel/time/timer.c:1519 [inline]
 __run_timers+0x554/0x718 kernel/time/timer.c:1790
 run_timer_softirq+0x7c/0x114 kernel/time/timer.c:1803
 __do_softirq+0x30c/0xea0 kernel/softirq.c:571
 ____do_softirq+0x14/0x20 arch/arm64/kernel/irq.c:79
 call_on_irq_stack+0x24/0x4c arch/arm64/kernel/entry.S:889
 do_softirq_own_stack+0x20/0x2c arch/arm64/kernel/irq.c:84
 invoke_softirq kernel/softirq.c:452 [inline]
 __irq_exit_rcu+0x28c/0x534 kernel/softirq.c:650
 irq_exit_rcu+0x14/0x84 kernel/softirq.c:662
 __el1_irq arch/arm64/kernel/entry-common.c:472 [inline]
 el1_interrupt+0x38/0x68 arch/arm64/kernel/entry-common.c:486
 el1h_64_irq_handler+0x18/0x24 arch/arm64/kernel/entry-common.c:491
 el1h_64_irq+0x64/0x68 arch/arm64/kernel/entry.S:577
 arch_local_irq_enable+0xc/0x18 arch/arm64/include/asm/irqflags.h:35
 default_idle_call+0x68/0xdc kernel/sched/idle.c:109
 cpuidle_idle_call kernel/sched/idle.c:191 [inline]
 do_idle+0x1e0/0x514 kernel/sched/idle.c:303
 cpu_startup_entry+0x24/0x28 kernel/sched/idle.c:400
 rest_init+0x2d8/0x2f0 init/main.c:729
 start_kernel+0x0/0x60c init/main.c:890
 start_kernel+0x44c/0x60c init/main.c:1145
 __primary_switched+0xb8/0xc0 arch/arm64/kernel/head.S:468

Crashes (7):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/06/06 19:11 linux-6.1.y 76ba310227d2 a4ae4f42 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in fq_pie_timer
2023/06/03 01:22 linux-6.1.y d2869ace6eeb a4ae4f42 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in fq_pie_timer
2023/06/02 13:55 linux-6.1.y d2869ace6eeb a4ae4f42 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in fq_pie_timer
2023/06/10 12:54 linux-6.1.y 2f3918bc53fb 49519f06 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in fq_pie_timer
2023/06/09 17:48 linux-6.1.y 2f3918bc53fb 9018a337 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in fq_pie_timer
2023/06/07 20:37 linux-6.1.y 76ba310227d2 058b3a5a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in fq_pie_timer
2023/06/05 16:57 linux-6.1.y 76ba310227d2 a4ae4f42 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in fq_pie_timer
* Struck through repros no longer work on HEAD.