syzbot


INFO: rcu detected stall in net_tx_action

Status: auto-obsoleted due to no activity on 2024/08/13 22:03
Subsystems: net
[Documentation on labels]
Reported-by: syzbot+3ba0493d523d007b3819@syzkaller.appspotmail.com
First crash: 1298d, last: 255d
Cause bisection: introduced by (bisect log) [merge commit]:
commit 08b0109eea36d71f87b863045d91bbcee98758bd
Author: Kalle Valo <kvalo@codeaurora.org>
Date: Mon Oct 1 15:49:48 2018 +0000

  Merge tag 'iwlwifi-next-for-kalle-2018-09-28' of git://git.kernel.org/pub/scm/linux/kernel/git/iwlwifi/iwlwifi-next

Crash: general protection fault in batadv_iv_ogm_queue_add (log)
Repro: C syz .config
  
Fix bisection: fixed by (bisect log) :
commit 0a9a25ca78437b39e691bcc3dc8240455b803d8d
Author: Ming Lei <ming.lei@redhat.com>
Date: Fri Mar 18 13:01:43 2022 +0000

  block: let blkcg_gq grab request queue's refcnt

  
Discussions (1)
Title Replies (including bot) Last reply
[syzbot] INFO: rcu detected stall in net_tx_action 1 (3) 2022/07/27 16:00
Similar bugs (3)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 BUG: soft lockup in net_tx_action 1 1223d 1223d 0/1 auto-closed as invalid on 2022/01/08 10:24
linux-5.15 BUG: soft lockup in net_tx_action origin:upstream C 1 48d 572d 0/3 upstream: reported C repro on 2023/06/23 13:57
android-5-15 BUG: soft lockup in net_tx_action 1 512d 512d 0/2 auto-obsoleted due to no activity on 2023/11/20 11:28
Last patch testing requests (24)
Created Duration User Patch Repo Result
2024/07/31 03:30 29m retest repro net OK log
2024/06/22 04:58 24m retest repro net OK log
2024/06/22 04:58 25m retest repro net OK log
2024/05/21 22:53 21m retest repro net report log
2024/04/08 05:22 22m retest repro net error
2024/04/08 05:22 22m retest repro net error
2024/03/12 20:14 24m retest repro net report log
2024/02/24 21:25 23m retest repro net-next OK log
2024/02/24 21:25 24m retest repro net-next OK log
2024/02/24 18:05 2h34m retest repro net-next OK log
2022/07/31 02:02 18m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git f80e2148 OK log
2022/07/30 22:33 10m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git f80e2148 report log
2022/07/30 11:44 10m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git f80e2148 report log
2022/07/30 09:47 16m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git f80e2148 error
2022/07/28 09:56 18m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git f80e2148 OK log
2022/07/28 08:13 18m hdanton@sina.com upstream OK log
2022/07/28 07:33 12m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git f80e21489590 report log
2022/07/28 04:29 13m hdanton@sina.com https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git f80e21489590 report log
2022/07/28 03:26 4m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git d6765985 error
2022/07/28 02:46 12m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git d6765985 report log
2022/07/28 00:13 13m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git d6765985 report log
2022/07/27 13:28 14m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git d6765985 report log
2022/07/27 13:00 14m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git d6765985 report log
2022/07/27 12:01 11m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/netdev/net.git d6765985 report log
Fix bisection attempts (12)
Created Duration User Patch Repo Result
2022/07/26 10:14 5h34m bisect fix net-old OK (1) job log
2022/06/26 09:45 28m bisect fix net-old OK (0) job log log
2022/05/25 22:24 29m bisect fix net-old OK (0) job log log
2022/04/02 17:24 28m bisect fix net-old OK (0) job log log
2022/03/03 16:55 29m bisect fix net-old OK (0) job log log
2022/02/01 16:25 29m bisect fix net-old OK (0) job log log
2021/12/25 23:59 30m bisect fix net-old OK (0) job log log
2021/11/25 23:29 29m bisect fix net-old OK (0) job log log
2021/10/26 23:02 26m bisect fix net-old OK (0) job log log
2021/09/26 02:48 28m bisect fix net-old OK (0) job log log
2021/08/27 02:18 29m bisect fix net-old OK (0) job log log
2021/07/28 01:47 30m bisect fix net-old OK (0) job log log

Sample crash report:
rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 1-.... } 2633 jiffies s: 1661 root: 0x2/.
rcu: blocking rcu_node structures (internal RCU debug):
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 5069 Comm: syz-executor999 Not tainted 6.5.0-rc7-syzkaller-00013-g53663f4103ff #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/26/2023
RIP: 0010:__lock_is_held kernel/locking/lockdep.c:5499 [inline]
RIP: 0010:lock_is_held_type+0x88/0x140 kernel/locking/lockdep.c:5832
Code: 6c 8a 45 31 ff e8 38 10 00 00 41 8b 84 24 c0 0a 00 00 4d 8d ac 24 c8 0a 00 00 65 ff 05 71 4a d0 75 85 c0 7f 13 e9 8a 00 00 00 <41> 83 c7 01 45 3b bc 24 c0 0a 00 00 7d 7c 49 63 c7 48 89 ee 48 8d
RSP: 0018:ffffc900001e09e8 EFLAGS: 00000046
RAX: 0000000000000000 RBX: ffff888020188b18 RCX: 0000000000000001
RDX: 0000000000000000 RSI: ffff888029bef300 RDI: ffff888020188b18
RBP: ffff888029bef300 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffff888020188000
R13: ffff888020188ac8 R14: 00000000ffffffff R15: 0000000000000002
FS:  0000555555dc93c0(0000) GS:ffff8880b9900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000600 CR3: 00000000244f1000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 lock_is_held include/linux/lockdep.h:288 [inline]
 advance_sched+0x707/0xc60 net/sched/sch_taprio.c:940
 __run_hrtimer kernel/time/hrtimer.c:1688 [inline]
 __hrtimer_run_queues+0x203/0xc10 kernel/time/hrtimer.c:1752
 hrtimer_interrupt+0x31b/0x800 kernel/time/hrtimer.c:1814
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1098 [inline]
 __sysvec_apic_timer_interrupt+0x14a/0x430 arch/x86/kernel/apic/apic.c:1115
 sysvec_apic_timer_interrupt+0x42/0xc0 arch/x86/kernel/apic/apic.c:1109
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:645
RIP: 0010:get_current arch/x86/include/asm/current.h:41 [inline]
RIP: 0010:__sanitizer_cov_trace_pc+0x17/0x70 kernel/kcov.c:206
Code: ff ff ff 31 c0 c3 66 66 2e 0f 1f 84 00 00 00 00 00 66 90 f3 0f 1e fa 65 8b 05 dd b0 7d 7e 89 c1 48 8b 34 24 81 e1 00 01 00 00 <65> 48 8b 14 25 80 b9 03 00 a9 00 01 ff 00 74 0e 85 c9 74 35 8b 82
RSP: 0018:ffffc900001e0d58 EFLAGS: 00000206
RAX: 0000000000000102 RBX: ffff888029be9394 RCX: 0000000000000100
RDX: ffff888020188000 RSI: ffffffff8859754b RDI: 0000000000000004
RBP: 0000000000000009 R08: 0000000000000004 R09: 0000000000000009
R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000010
R13: ffff88802c142b60 R14: 000000000000000c R15: 0000000000000001
 taprio_dequeue_tc_priority+0x38b/0x4b0 net/sched/sch_taprio.c:806
 taprio_dequeue+0x12e/0x5f0 net/sched/sch_taprio.c:868
 dequeue_skb net/sched/sch_generic.c:292 [inline]
 qdisc_restart net/sched/sch_generic.c:397 [inline]
 __qdisc_run+0x1c4/0x19d0 net/sched/sch_generic.c:415
 qdisc_run include/net/pkt_sched.h:125 [inline]
 qdisc_run include/net/pkt_sched.h:122 [inline]
 net_tx_action+0x71e/0xc80 net/core/dev.c:5049
 __do_softirq+0x218/0x965 kernel/softirq.c:553
 invoke_softirq kernel/softirq.c:427 [inline]
 __irq_exit_rcu kernel/softirq.c:632 [inline]
 irq_exit_rcu+0xb7/0x120 kernel/softirq.c:644
 sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1109
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:645
RIP: 0010:orc_find arch/x86/kernel/unwind_orc.c:218 [inline]
RIP: 0010:unwind_next_frame+0x205/0x2020 arch/x86/kernel/unwind_orc.c:494
Code: 89 74 24 20 89 44 24 18 e8 28 a2 a0 00 48 8b 4c 24 30 48 8b 44 24 28 8b 74 24 20 44 8b 5c 24 18 8d 50 01 8b 0c 8d c8 4c dd 8f <48> b8 00 00 00 00 00 fc ff df 48 8d 3c 95 c8 4c dd 8f 49 89 f8 49
RSP: 0018:ffffc90003bb78e8 EFLAGS: 00000246
RAX: 000000000007e385 RBX: 0000000000000001 RCX: 0000000000187ee4
RDX: 000000000007e386 RSI: 0000000000096001 RDI: ffffffff8ffcdadc
RBP: ffffc90003bb79a0 R08: 0000000000000000 R09: ffffffff8fbfbb82
R10: ffffc90003bb7958 R11: 000000000007e385 R12: ffffc90003bb79a8
R13: ffffc90003bb7958 R14: ffffc90003bb798d R15: ffffffff88e385cd
 arch_stack_walk+0x8b/0xf0 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x96/0xd0 kernel/stacktrace.c:122
 kasan_save_stack+0x33/0x50 mm/kasan/common.c:45
 kasan_set_track+0x25/0x30 mm/kasan/common.c:52
 __kasan_slab_alloc+0x81/0x90 mm/kasan/common.c:328
 kasan_slab_alloc include/linux/kasan.h:186 [inline]
 slab_post_alloc_hook mm/slab.h:762 [inline]
 slab_alloc_node mm/slub.c:3470 [inline]
 slab_alloc mm/slub.c:3478 [inline]
 __kmem_cache_alloc_lru mm/slub.c:3485 [inline]
 kmem_cache_alloc+0x172/0x3b0 mm/slub.c:3494
 sk_prot_alloc+0x60/0x2a0 net/core/sock.c:2082
 sk_alloc+0x3a/0x7f0 net/core/sock.c:2141
 unix_create1+0xaa/0x930 net/unix/af_unix.c:983
 unix_create+0x10e/0x1d0 net/unix/af_unix.c:1050
 __sock_create+0x334/0x810 net/socket.c:1536
 sock_create net/socket.c:1587 [inline]
 __sys_socket_create net/socket.c:1624 [inline]
 __sys_socket+0x13d/0x250 net/socket.c:1652
 __do_sys_socket net/socket.c:1665 [inline]
 __se_sys_socket net/socket.c:1663 [inline]
 __x64_sys_socket+0x72/0xb0 net/socket.c:1663
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x38/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f81c75c8727
Code: c7 c0 ff ff ff ff c3 0f 1f 40 00 48 c7 c2 b0 ff ff ff f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b7 0f 1f 00 b8 29 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b0 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007ffdb287ee48 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
RAX: ffffffffffffffda RBX: 00007f81c761621f RCX: 00007f81c75c8727
RDX: 0000000000000000 RSI: 0000000000080002 RDI: 0000000000000001
RBP: 00007ffdb287ee60 R08: 0000000000000000 R09: 007664617461625f
R10: 0000000000000005 R11: 0000000000000246 R12: 00007ffdb287f090
R13: 00003baaaaaaaaaa R14: 00007ffdb287f0c0 R15: 00007f81c761621f
 </TASK>

Crashes (37):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/08/23 05:48 upstream 53663f4103ff b81ca3f6 .config console log report syz C ci-upstream-kasan-gce INFO: rcu detected stall in net_tx_action
2023/07/20 16:02 upstream bfa3037d8280 7b630fdb .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in net_tx_action
2023/12/19 19:19 net 3dc5d4454545 3ad490ea .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in net_tx_action
2023/08/22 06:28 net be809424659c 6b415825 .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in net_tx_action
2023/07/25 18:13 net 284779dbf4e9 6756545c .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in net_tx_action
2021/06/27 15:39 net-old d6765985a42a 9d2ab5df .config console log report syz C ci-upstream-net-this-kasan-gce INFO: rcu detected stall in net_tx_action
2023/08/22 06:36 net-next 7eb6deb3f556 6b415825 .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in net_tx_action
2023/05/29 22:52 net-next 75455b906d82 cf184559 .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in net_tx_action
2022/08/13 06:26 net-next-old 7ebfc85e2cd7 8dfcaa3d .config strace log report syz C ci-upstream-net-kasan-gce INFO: rcu detected stall in net_tx_action
2023/05/29 23:45 net 9b9e46aa0727 cf184559 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce BUG: soft lockup in net_tx_action
2022/01/02 16:20 net-next-old c95e078069bf e1768e9c .config console log report syz C ci-upstream-net-kasan-gce BUG: soft lockup in net_tx_action
2023/09/23 15:01 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci fe4469582053 0b6a67ac .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
2023/09/22 17:12 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci fe4469582053 0b6a67ac .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
2023/09/20 06:04 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci fe4469582053 0b6a67ac .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
2023/09/16 12:44 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci fe4469582053 0b6a67ac .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
2023/07/24 14:07 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci e40939bbfc68 06460670 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
2023/08/12 18:45 upstream f8de32cc060b 39990d51 .config strace log report syz [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in net_tx_action
2023/07/26 00:33 upstream af2e19389c2c 6756545c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in net_tx_action
2023/07/20 13:31 upstream bfa3037d8280 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in net_tx_action
2023/07/20 13:31 upstream bfa3037d8280 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in net_tx_action
2023/07/20 13:28 upstream bfa3037d8280 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in net_tx_action
2023/07/20 13:28 upstream bfa3037d8280 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in net_tx_action
2023/07/25 22:35 upstream af2e19389c2c 6756545c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-386 INFO: rcu detected stall in net_tx_action
2023/07/26 04:50 net 55cef78c244d 6756545c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in net_tx_action
2023/07/20 13:37 net 9f9d4c1a2e82 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in net_tx_action
2023/07/26 04:57 net-next 09bd2d7ddaed 6756545c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in net_tx_action
2023/07/25 21:47 net-next ec87f05402f5 6756545c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in net_tx_action
2023/07/20 13:35 net-next 03b123debcbc 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in net_tx_action
2022/08/13 03:15 net-next-old 7ebfc85e2cd7 8dfcaa3d .config console log report info ci-upstream-net-kasan-gce INFO: rcu detected stall in net_tx_action
2024/04/27 02:01 linux-next bb7a2467e6be 07b455f9 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in net_tx_action
2023/07/25 20:31 linux-next 1e25dd777248 6756545c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in net_tx_action
2023/07/20 13:58 linux-next c58c49dd8932 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in net_tx_action
2022/04/25 22:24 linux-next e7d6987e09a3 152baedd .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in net_tx_action
2023/07/20 22:03 upstream 46670259519f 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root BUG: soft lockup in net_tx_action
2024/05/05 22:02 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci 78186bd77b47 610f2a54 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
2023/07/25 20:24 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci e40939bbfc68 6756545c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
2023/07/20 13:31 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci e40939bbfc68 7b630fdb .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in net_tx_action
* Struck through repros no longer work on HEAD.