syzbot


INFO: rcu detected stall in worker_thread (9)

Status: upstream: reported C repro on 2023/10/07 18:33
Subsystems: netfilter
[Documentation on labels]
Reported-by: syzbot+225bfad78b079744fd5e@syzkaller.appspotmail.com
First crash: 206d, last: 37m
Cause bisection: introduced by (bisect log) :
commit c2368b19807affd7621f7c4638cd2e17fec13021
Author: Jiri Pirko <jiri@nvidia.com>
Date: Fri Jul 29 07:10:35 2022 +0000

  net: devlink: introduce "unregistering" mark and use it during devlinks iteration

Crash: INFO: rcu detected stall in corrupted (log)
Repro: syz .config
  
Discussions (3)
Title Replies (including bot) Last reply
[syzbot] Monthly netfilter report (Feb 2024) 0 (1) 2024/02/09 08:36
[syzbot] [net?] [usb?] INFO: rcu detected stall in worker_thread (9) 0 (3) 2023/11/14 18:18
[PATCH] media: imon: fix stall in worker_thread 4 (4) 2023/10/14 07:28
Similar bugs (9)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in worker_thread (3) cgroups mm 1 1571d 1571d 0/26 closed as invalid on 2020/01/08 05:33
upstream INFO: rcu detected stall in worker_thread (4) cgroups mm 28 1570d 1571d 0/26 closed as invalid on 2020/01/09 08:13
linux-5.15 INFO: rcu detected stall in worker_thread 1 211d 211d 0/3 auto-obsoleted due to no activity on 2024/01/09 18:17
upstream INFO: rcu detected stall in worker_thread (8) kernel 1 354d 354d 0/26 auto-obsoleted due to no activity on 2023/08/07 05:14
upstream INFO: rcu detected stall in worker_thread (5) kernel 2 695d 732d 0/26 auto-closed as invalid on 2022/08/31 00:50
upstream INFO: rcu detected stall in worker_thread (2) cgroups mm 12 1571d 1571d 0/26 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in worker_thread cgroups mm 150 1605d 1607d 0/26 closed as invalid on 2019/12/04 14:14
upstream INFO: rcu detected stall in worker_thread (6) kernel 1 570d 570d 0/26 auto-obsoleted due to no activity on 2023/01/12 15:50
upstream INFO: rcu detected stall in worker_thread (7) kernel 1 463d 463d 0/26 auto-obsoleted due to no activity on 2023/04/27 16:37
Last patch testing requests (6)
Created Duration User Patch Repo Result
2024/01/13 14:32 23m retest repro upstream report log
2023/12/13 13:09 18m retest repro upstream report log
2023/12/13 13:09 16m retest repro upstream report log
2023/12/13 13:09 23m retest repro upstream OK log
2023/10/10 03:05 48m twuufnxlz@gmail.com patch https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git ce36c8b14987 OK log
2023/10/08 11:16 20m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master OK log

Sample crash report:
rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 1-...D } 2655 jiffies s: 613 root: 0x2/.
rcu: blocking rcu_node structures (internal RCU debug):
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 11 Comm: kworker/u8:1 Not tainted 6.9.0-rc5-syzkaller-00159-gc942a0cd3603 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024
Workqueue: ipv6_addrconf addrconf_dad_work
RIP: 0010:__lock_acquire+0x47c/0x1fd0 kernel/locking/lockdep.c:5080
Code: 41 09 c7 41 09 cf 41 09 ff 48 8b 44 24 20 0f b6 04 30 84 c0 0f 85 13 13 00 00 44 8b a4 24 e0 00 00 00 48 8b 44 24 10 44 89 38 <49> 89 c7 4c 8b 74 24 28 4b 8d 5c f0 24 48 89 d8 48 c1 e8 03 0f b6
RSP: 0018:ffffc90000a087f0 EFLAGS: 00000046
RAX: ffff888016eec888 RBX: 0000000000004000 RCX: 0000000000040000
RDX: 0000000000080000 RSI: dffffc0000000000 RDI: 000000000000c000
RBP: 0000000000000032 R08: ffff888016eec6d8 R09: 0000000000000001
R10: dffffc0000000000 R11: fffffbfff1f51fde R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000001 R15: 00000000000cc000
FS:  0000000000000000(0000) GS:ffff8880b9500000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000600 CR3: 000000000e134000 CR4: 0000000000350ef0
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 lock_acquire+0x1ed/0x550 kernel/locking/lockdep.c:5754
 debug_objects_fill_pool+0x9f/0x9b0 lib/debugobjects.c:614
 debug_object_activate+0x135/0x510 lib/debugobjects.c:704
 debug_hrtimer_activate kernel/time/hrtimer.c:423 [inline]
 debug_activate kernel/time/hrtimer.c:478 [inline]
 enqueue_hrtimer+0x30/0x3c0 kernel/time/hrtimer.c:1090
 __run_hrtimer kernel/time/hrtimer.c:1709 [inline]
 __hrtimer_run_queues+0x6d5/0xd50 kernel/time/hrtimer.c:1756
 hrtimer_interrupt+0x396/0x990 kernel/time/hrtimer.c:1818
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1032 [inline]
 __sysvec_apic_timer_interrupt+0x112/0x3f0 arch/x86/kernel/apic/apic.c:1049
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1043 [inline]
 sysvec_apic_timer_interrupt+0xa1/0xc0 arch/x86/kernel/apic/apic.c:1043
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702
RIP: 0010:ipv6_get_saddr_eval+0x56b/0xf50 net/ipv6/addrconf.c:1666
Code: 85 f4 07 00 00 41 8b 0e 48 89 df 48 8b 74 24 20 8b 54 24 1c e8 76 fe 01 00 89 c3 49 83 c4 10 4c 89 e0 48 c1 e8 03 0f b6 04 28 <84> c0 0f 85 e5 07 00 00 41 8b 2c 24 89 df 89 ee e8 80 b1 73 f7 45
RSP: 0018:ffffc90000106b30 EFLAGS: 00000216
RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffc90000106a03
RDX: 0000000000000009 RSI: ffffffff8bcaca20 RDI: ffffffff8c1f96e0
RBP: dffffc0000000000 R08: ffffffff8fa8feef R09: 1ffffffff1f51fdd
R10: dffffc0000000000 R11: fffffbfff1f51fde R12: ffffc90000106cd0
R13: ffff888022164000 R14: ffff888079e4a0e0 R15: 0000000000000006
 __ipv6_dev_get_saddr+0x1d3/0x4b0 net/ipv6/addrconf.c:1753
 ipv6_dev_get_saddr+0x42b/0xba0 net/ipv6/addrconf.c:1888
 ip6_route_get_saddr include/net/ip6_route.h:140 [inline]
 ip6_dst_lookup_tail+0xc83/0x11a0 net/ipv6/ip6_output.c:1125
 ip6_dst_lookup_flow+0xb9/0x180 net/ipv6/ip6_output.c:1250
 udp_tunnel6_dst_lookup+0x2c0/0x520 net/ipv6/ip6_udp_tunnel.c:165
 geneve6_xmit_skb drivers/net/geneve.c:942 [inline]
 geneve_xmit+0xb99/0x2e60 drivers/net/geneve.c:1027
 __netdev_start_xmit include/linux/netdevice.h:4903 [inline]
 netdev_start_xmit include/linux/netdevice.h:4917 [inline]
 xmit_one net/core/dev.c:3531 [inline]
 dev_hard_start_xmit+0x27c/0x7e0 net/core/dev.c:3547
 __dev_queue_xmit+0x1ad1/0x3ca0 net/core/dev.c:4341
 neigh_output include/net/neighbour.h:542 [inline]
 ip6_finish_output2+0xffa/0x1670 net/ipv6/ip6_output.c:137
 ip6_finish_output+0x41e/0x810 net/ipv6/ip6_output.c:222
 NF_HOOK include/linux/netfilter.h:314 [inline]
 ndisc_send_skb+0xab0/0x1380 net/ipv6/ndisc.c:509
 ndisc_send_ns+0xcc/0x160 net/ipv6/ndisc.c:667
 addrconf_dad_work+0xb45/0x16f0 net/ipv6/addrconf.c:4280
 process_one_work kernel/workqueue.c:3254 [inline]
 process_scheduled_works+0xa12/0x17c0 kernel/workqueue.c:3335
 worker_thread+0x86d/0xd70 kernel/workqueue.c:3416
 kthread+0x2f2/0x390 kernel/kthread.c:388
 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 4.760 msecs

Crashes (118):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/04/26 23:15 upstream c942a0cd3603 059e9963 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/26 15:25 upstream c942a0cd3603 059e9963 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in worker_thread
2024/04/22 03:06 upstream 48cf398f15fc af24b050 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/13 12:23 upstream fe46a7dd189e c8349e48 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/06 19:47 upstream fe46a7dd189e ca620dd8 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/03/01 11:21 upstream 87adedeba51a 352ab904 .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in worker_thread
2024/02/28 12:57 upstream cf1182944c7c d367cbe5 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in worker_thread
2023/11/14 18:18 upstream 9bacdd8996c7 cb976f63 .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/03/25 04:55 net-next 237bb5f7f7f5 0ea90952 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in worker_thread
2024/02/15 10:01 net-next d1d77120bc28 d9b1cdd5 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in worker_thread
2024/02/16 01:57 upstream 4f5e5092fdbf d9b1cdd5 .config console log report syz [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in worker_thread
2023/12/20 20:03 upstream 55cb5f43689d 3ad490ea .config console log report syz [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2023/10/11 13:23 upstream 1c8b86a3799f 83165b57 .config console log report syz [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/03/24 23:31 net-next 237bb5f7f7f5 0ea90952 .config strace log report syz [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in worker_thread
2023/10/03 18:27 upstream ce36c8b14987 65faba36 .config console log report syz [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/26 06:19 upstream e33c4963bf53 8bdc0f22 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/26 05:17 upstream e33c4963bf53 8bdc0f22 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/26 01:59 upstream e33c4963bf53 8bdc0f22 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/24 23:18 upstream e88c4cfcb7b8 8bdc0f22 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/24 13:06 upstream 9d1ddab261f3 21339d7b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/23 17:12 upstream 71b1543c83d6 21339d7b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/23 10:53 upstream 4d2008430ce8 21339d7b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/22 22:39 upstream 4d2008430ce8 21339d7b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/22 05:52 upstream 3b68086599f8 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/22 00:50 upstream 3b68086599f8 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/21 15:58 upstream 977b1ef51866 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/21 07:51 upstream 977b1ef51866 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/20 12:50 upstream 13a2e429f644 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/20 08:01 upstream 3cdb45594619 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/19 22:55 upstream 3cdb45594619 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/19 20:12 upstream 3cdb45594619 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/15 04:46 upstream fe46a7dd189e c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/13 10:57 upstream fe46a7dd189e c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/12 03:50 upstream fe46a7dd189e 478efa7f .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/08 08:50 upstream fe46a7dd189e ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/08 07:38 upstream fe46a7dd189e ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/08 00:25 upstream fe46a7dd189e ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/03/31 12:53 upstream 480e035fc4c7 6baf5069 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in worker_thread
2024/03/31 12:53 upstream 480e035fc4c7 6baf5069 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in worker_thread
2024/03/26 21:47 upstream fe46a7dd189e 454571b6 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/03/26 12:32 upstream fe46a7dd189e bcd9b39f .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/03/22 16:04 upstream fe46a7dd189e 7a239ce7 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in worker_thread
2024/04/10 23:42 net f99c5f563c17 56086b24 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in worker_thread
2024/04/07 06:16 net f99c5f563c17 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in worker_thread
2024/04/04 23:16 net f99c5f563c17 0ee3535e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in worker_thread
2024/04/26 10:10 net-next 2bd87951de65 8bdc0f22 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in worker_thread
2024/04/27 08:54 linux-next bb7a2467e6be 07b455f9 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/23 09:17 linux-next 7b4f2bc91c15 21339d7b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/22 13:50 linux-next 7b4f2bc91c15 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/22 06:56 linux-next 7b4f2bc91c15 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/21 22:03 linux-next 7b4f2bc91c15 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/18 14:15 linux-next 7b4f2bc91c15 af24b050 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/18 00:12 linux-next 4eab35893071 bd38b692 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/16 14:22 linux-next 66e4190e92ce 0d592ce4 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/14 06:16 linux-next 9ed46da14b9b c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/14 03:35 linux-next 9ed46da14b9b c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/13 00:51 linux-next 9ed46da14b9b c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/09 01:23 linux-next 11cb68ad52ac 53df08b6 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/08 11:16 linux-next 11cb68ad52ac ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/08 04:03 linux-next 8568bb2ccc27 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/07 19:34 linux-next 8568bb2ccc27 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/07 09:47 linux-next 8568bb2ccc27 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/06 11:46 linux-next 8568bb2ccc27 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/06 06:00 linux-next 8568bb2ccc27 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/04/04 21:56 linux-next 2b3d5988ae2c 0ee3535e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/03/29 06:23 linux-next a6bd6c933339 120789fd .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in worker_thread
2024/03/04 01:00 upstream 58c806d867bf 25905f5d .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root BUG: soft lockup in worker_thread
* Struck through repros no longer work on HEAD.