syzbot


BUG: soft lockup in garp_join_timer
Status: upstream: reported on 2021/06/11 07:01
Reported-by: syzbot+c8fad93d6042c360ee83@syzkaller.appspotmail.com
First crash: 348d, last: 22d
similar bugs (7):
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream BUG: soft lockup in garp_join_timer 1 491d 491d 0/22 auto-closed as invalid on 2021/04/19 17:30
upstream INFO: rcu detected stall in garp_join_timer (2) 25 130d 829d 0/22 auto-closed as invalid on 2022/05/15 13:33
linux-4.19 INFO: rcu detected stall in garp_join_timer 7 837d 868d 0/1 auto-closed as invalid on 2020/06/07 13:30
upstream INFO: rcu detected stall in garp_join_timer 1 908d 908d 0/22 closed as invalid on 2019/11/29 14:24
linux-4.14 INFO: rcu detected stall in garp_join_timer 4 832d 847d 0/1 auto-closed as invalid on 2020/06/12 11:13
linux-4.19 INFO: rcu detected stall in garp_join_timer (2) 1 704d 704d 0/1 auto-closed as invalid on 2020/10/18 11:34
linux-4.19 INFO: rcu detected stall in garp_join_timer (3) 1 497d 497d 0/1 auto-closed as invalid on 2021/05/13 13:34

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [syz-executor.1:2793]
Modules linked in:
irq event stamp: 3750991
hardirqs last  enabled at (3750990): [<ffffffff81003ce4>] trace_hardirqs_on_thunk+0x1a/0x1c
hardirqs last disabled at (3750991): [<ffffffff81003d00>] trace_hardirqs_off_thunk+0x1a/0x1c
softirqs last  enabled at (42): [<ffffffff86a083e2>] netlink_create+0x3c2/0x5e0 net/netlink/af_netlink.c:712
softirqs last disabled at (169): [<ffffffff813927d5>] invoke_softirq kernel/softirq.c:372 [inline]
softirqs last disabled at (169): [<ffffffff813927d5>] irq_exit+0x215/0x260 kernel/softirq.c:412
CPU: 0 PID: 2793 Comm: syz-executor.1 Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:queued_spin_lock include/asm-generic/qspinlock.h:86 [inline]
RIP: 0010:do_raw_spin_lock+0xd7/0x220 kernel/locking/spinlock_debug.c:113
Code: 55 08 65 8b 05 8a a2 b5 7e 39 c2 0f 84 84 00 00 00 be 04 00 00 00 48 89 ef e8 35 70 4c 00 31 c0 ba 01 00 00 00 f0 0f b1 55 00 <85> c0 75 7b 65 8b 1d 5e a2 b5 7e 48 b8 00 00 00 00 00 fc ff df 4c
RSP: 0018:ffff8880ba007cc8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000000 RBX: ffff8880222fa810 RCX: ffffffff814bdebb
RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff8880222fa858
RBP: ffff8880222fa858 R08: 0000000000000001 R09: ffffed100445f50b
R10: ffff8880222fa85b R11: 0000000000000000 R12: ffff8880222fa860
R13: ffff8880222fa868 R14: 0000000000000000 R15: 0000000000000000
FS:  00007f8b02afe700(0000) GS:ffff8880ba000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000380 CR3: 000000004334b000 CR4: 00000000003406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 spin_lock include/linux/spinlock.h:329 [inline]
 garp_join_timer+0x20/0xf0 net/802/garp.c:421
 call_timer_fn+0x177/0x700 kernel/time/timer.c:1338
 expire_timers+0x243/0x4e0 kernel/time/timer.c:1375
 __run_timers kernel/time/timer.c:1696 [inline]
 run_timer_softirq+0x21c/0x670 kernel/time/timer.c:1709
 __do_softirq+0x265/0x980 kernel/softirq.c:292
 invoke_softirq kernel/softirq.c:372 [inline]
 irq_exit+0x215/0x260 kernel/softirq.c:412
 exiting_irq arch/x86/include/asm/apic.h:536 [inline]
 smp_apic_timer_interrupt+0x136/0x550 arch/x86/kernel/apic/apic.c:1098
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:894
 </IRQ>
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:789 [inline]
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0xa3/0xe0 kernel/locking/spinlock.c:184
Code: 48 c7 c0 88 82 f1 89 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00 75 2f 48 83 3d 7c 31 d8 01 00 74 15 48 89 df 57 9d <0f> 1f 44 00 00 eb b2 e8 fb eb e6 f8 eb c0 0f 0b 0f 0b 48 c7 c7 88
RSP: 0018:ffff888232eafa10 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff13e3051 RBX: 0000000000000286 RCX: 0000000000000000
RDX: dffffc0000000000 RSI: 0000000000000001 RDI: 0000000000000286
RBP: ffff888037566bc8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
R13: ffff8880ba02b0c0 R14: ffff888037566400 R15: ffff888037566bc8
 try_to_wake_up+0x733/0x1050 kernel/sched/core.c:2056
 wake_up_process kernel/sched/core.c:2124 [inline]
 wake_up_q+0x82/0xe0 kernel/sched/core.c:442
 futex_wake+0x3e3/0x480 kernel/futex.c:1706
 do_futex+0x2ca/0x1880 kernel/futex.c:3894
 __do_sys_futex kernel/futex.c:3950 [inline]
 __se_sys_futex+0x28f/0x3b0 kernel/futex.c:3918
 do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f8b041890e9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f8b02afe218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
RAX: ffffffffffffffda RBX: 00007f8b0429bf68 RCX: 00007f8b041890e9
RDX: 00000000000f4240 RSI: 0000000000000081 RDI: 00007f8b0429bf6c
RBP: 00007f8b0429bf60 R08: 0000011c3290a82d R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 00007f8b0429bf6c
R13: 00007ffe8d83314f R14: 00007f8b02afe300 R15: 0000000000022000
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 2815 Comm: syz-executor.1 Not tainted 4.19.211-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:rcu_irq_exit+0xc3/0x100 kernel/rcu/tree.c:839
Code: fc ff df 48 89 fa 48 c1 ea 03 0f b6 04 02 84 c0 74 04 3c 03 7e 48 8b 83 50 08 00 00 85 c0 74 09 80 3d fd ba bc 09 00 74 06 5b <e9> b8 fd ff ff 48 c7 c7 a0 64 6b 88 c6 05 e7 ba bc 09 01 e8 3a cd
RSP: 0018:ffff8880ba107c18 EFLAGS: 00000046
RAX: 0000000000000000 RBX: ffff8880ba11e2c0 RCX: 0000000000000001
RDX: 1ffff110465cb90a RSI: ffffffff83771e31 RDI: ffff888232e5c850
RBP: 0000000000000000 R08: ffffffff8c665058 R09: 0000000000000000
R10: 0000000000000005 R11: ffffffff8c66505b R12: ffff888232ee7538
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS:  00007f8b02add700(0000) GS:ffff8880ba100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020001600 CR3: 000000004334b000 CR4: 00000000003406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 irq_exit+0xb7/0x260 kernel/softirq.c:415
 exiting_irq arch/x86/include/asm/apic.h:536 [inline]
 smp_apic_timer_interrupt+0x136/0x550 arch/x86/kernel/apic/apic.c:1098
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:894
RIP: 0010:mod_timer+0x0/0x1010 kernel/time/timer.c:1113
Code: e8 b5 c4 0e 00 4c 89 e0 5b 5d 41 5c 41 5d 41 5e 41 5f c3 48 c7 c7 80 d9 e0 89 e8 8b a1 44 00 e9 6e ff ff ff 66 0f 1f 44 00 00 <41> 57 41 56 41 55 41 54 49 bc 00 00 00 00 00 fc ff df 55 48 89 fd
RSP: 0018:ffff8880ba107d20 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000011 RBX: ffff888093564290 RCX: dffffc0000000000
RDX: 1ffffffff13c1b30 RSI: 00000001000143c2 RDI: ffff888093564290
RBP: 0000000000000101 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000005 R11: 0000000000000000 R12: ffff8880ba107d58
R13: 1ffff11017420fa7 R14: 0000000000000000 R15: 0000000000000000
 call_timer_fn+0x177/0x700 kernel/time/timer.c:1338
 expire_timers+0x243/0x4e0 kernel/time/timer.c:1375
 __run_timers kernel/time/timer.c:1696 [inline]
 run_timer_softirq+0x21c/0x670 kernel/time/timer.c:1709
 __do_softirq+0x265/0x980 kernel/softirq.c:292
 invoke_softirq kernel/softirq.c:372 [inline]
 irq_exit+0x215/0x260 kernel/softirq.c:412
 exiting_irq arch/x86/include/asm/apic.h:536 [inline]
 smp_apic_timer_interrupt+0x136/0x550 arch/x86/kernel/apic/apic.c:1098
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:894
 </IRQ>
RIP: 0010:preempt_count_sub+0xc4/0x150 kernel/sched/core.c:3267
Code: 00 00 8b 15 ce 89 f5 0b 85 d2 75 bd 48 c7 c6 80 ba 69 88 48 c7 c7 c0 ba 69 88 e8 cc 4f b1 06 0f 0b 5b c3 65 8b 05 bc 71 c0 7e <84> c0 75 8b e8 53 e4 31 02 85 c0 74 92 48 c7 c0 40 f7 36 8d 48 ba
RSP: 0018:ffff888232ee75e8 EFLAGS: 00000297 ORIG_RAX: ffffffffffffff13
RAX: 0000000080000001 RBX: 0000000000000001 RCX: 0000000000000000
RDX: 0000000000000004 RSI: ffff888232ee7588 RDI: 0000000000000001
RBP: ffff888232ee7df8 R08: 0000000000000001 R09: 0000000000000001
R10: ffff888232ee7787 R11: 0000000000074071 R12: ffff888232ee0000
R13: ffff888232ee775d R14: ffff888232ee7728 R15: ffffffff8b90fb0e
 unwind_next_frame+0xeee/0x1400 arch/x86/kernel/unwind_orc.c:579
 __save_stack_trace+0x9f/0x190 arch/x86/kernel/stacktrace.c:44
 save_stack mm/kasan/kasan.c:448 [inline]
 set_track mm/kasan/kasan.c:460 [inline]
 kasan_kmalloc+0xeb/0x160 mm/kasan/kasan.c:553
 slab_post_alloc_hook mm/slab.h:445 [inline]
 slab_alloc mm/slab.c:3397 [inline]
 kmem_cache_alloc+0x110/0x370 mm/slab.c:3557
 kmem_cache_zalloc include/linux/slab.h:699 [inline]
 fill_pool lib/debugobjects.c:134 [inline]
 __debug_object_init+0x6d9/0x9b0 lib/debugobjects.c:379
 debug_hrtimer_init kernel/time/hrtimer.c:410 [inline]
 debug_init kernel/time/hrtimer.c:458 [inline]
 hrtimer_init+0x27/0x2f0 kernel/time/hrtimer.c:1375
 init_dl_inactive_task_timer+0x1a/0x50 kernel/sched/deadline.c:1328
 __sched_fork+0x215/0x470 kernel/sched/core.c:2162
 sched_fork+0x16/0xb70 kernel/sched/core.c:2297
 copy_process.part.0+0x1884/0x8260 kernel/fork.c:1883
 copy_process kernel/fork.c:1710 [inline]
 _do_fork+0x22f/0xf30 kernel/fork.c:2219
 do_syscall_64+0xf9/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f8b041890e9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f8b02add118 EFLAGS: 00000206 ORIG_RAX: 0000000000000038
RAX: ffffffffffffffda RBX: 00007f8b0429c030 RCX: 00007f8b041890e9
RDX: 0000000020000200 RSI: 00000000200001c0 RDI: 0000000000004000
RBP: 00007f8b041e308d R08: 0000000020000400 R09: 0000000020000400
R10: 0000000020000240 R11: 0000000000000206 R12: 0000000000000000
R13: 00007ffe8d83314f R14: 00007f8b02add300 R15: 0000000000022000
----------------
Code disassembly (best guess):
   0:	55                   	push   %rbp
   1:	08 65 8b             	or     %ah,-0x75(%rbp)
   4:	05 8a a2 b5 7e       	add    $0x7eb5a28a,%eax
   9:	39 c2                	cmp    %eax,%edx
   b:	0f 84 84 00 00 00    	je     0x95
  11:	be 04 00 00 00       	mov    $0x4,%esi
  16:	48 89 ef             	mov    %rbp,%rdi
  19:	e8 35 70 4c 00       	callq  0x4c7053
  1e:	31 c0                	xor    %eax,%eax
  20:	ba 01 00 00 00       	mov    $0x1,%edx
  25:	f0 0f b1 55 00       	lock cmpxchg %edx,0x0(%rbp)
* 2a:	85 c0                	test   %eax,%eax <-- trapping instruction
  2c:	75 7b                	jne    0xa9
  2e:	65 8b 1d 5e a2 b5 7e 	mov    %gs:0x7eb5a25e(%rip),%ebx        # 0x7eb5a293
  35:	48 b8 00 00 00 00 00 	movabs $0xdffffc0000000000,%rax
  3c:	fc ff df
  3f:	4c                   	rex.WR

Crashes (13):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Title
ci2-linux-4-19 2022/05/01 02:40 linux-4.19.y 3f8a27f9e27b 2df221f6 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2022/04/04 18:09 linux-4.19.y 3f8a27f9e27b 5915c2cb .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2022/03/01 03:45 linux-4.19.y 3f8a27f9e27b 45a13a73 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2022/02/20 07:38 linux-4.19.y 3f8a27f9e27b 3cd800e4 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2022/01/23 18:54 linux-4.19.y 3f8a27f9e27b 214351e1 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2021/12/30 01:26 linux-4.19.y 3f8a27f9e27b 6cc879d4 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2021/12/17 18:07 linux-4.19.y 3f8a27f9e27b 44068e19 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2021/10/31 21:15 linux-4.19.y 3f8a27f9e27b 098b5d53 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2021/09/28 19:45 linux-4.19.y c2276d585654 d82cb927 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2021/08/30 14:49 linux-4.19.y e23d55af0e1f 8f58a0ef .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2021/07/12 00:02 linux-4.19.y fcfbdfe9626e 8f5a7b8c .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2021/06/11 07:00 linux-4.19.y 9a2dc0e6c531 1ba81399 .config log report info BUG: soft lockup in garp_join_timer
ci2-linux-4-19 2022/05/03 14:47 linux-4.19.y 3f8a27f9e27b 2df221f6 .config log report info INFO: rcu detected stall in garp_join_timer