syzbot

 sign-in | mailing list | source | docs
🐞 Open [953] 🐞 Fixed [3801] 🐞 Invalid [8160] 📈 Kernel Health 📈 Bug Lifetimes 📈 Fuzzing 📈 Crashes

INFO: task hung in register_netdevice_notifier (2)
Status: fixed on 2021/11/10 00:50
Reported-by: syzbot+355f8edb2ff45d5f95fa@syzkaller.appspotmail.com
Fix commit: 8d0caedb7596 can: bcm/raw/isotp: use per module netdevice notifier
First crash: 1385d, last: 335d

Cause bisection: introduced by (bisect log) :
commit 6bf071bf09d4b2ff3ee8783531e2ce814f0870cb
Author: Jesper Dangaard Brouer <brouer@redhat.com>
Date: Tue Jun 18 13:05:27 2019 +0000

  xdp: page_pool related fix to cpumap

Crash: general protection fault in batadv_iv_ogm_queue_add (log)
Repro: syz .config
similar bugs (3):
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: task hung in register_netdevice_notifier 64 361d 1119d 0/1 auto-closed as invalid on 2021/09/21 07:27
upstream INFO: task hung in register_netdevice_notifier 602 1498d 1511d 0/22 closed as invalid on 2018/05/03 10:15
upstream INFO: task can't die in register_netdevice_notifier 94 327d 626d 0/22 auto-closed as invalid on 2021/08/27 02:37
Patch testing requests:
Created Duration User Patch Repo Result
2021/06/05 00:53 17m penguin-kernel@i-love.sakura.ne.jp patch upstream OK
2021/06/02 14:53 17m penguin-kernel@i-love.sakura.ne.jp patch upstream OK
2021/06/02 11:11 16m penguin-kernel@i-love.sakura.ne.jp patch upstream OK
2021/06/01 13:45 16m penguin-kernel@i-love.sakura.ne.jp patch upstream report log

Sample crash report:
INFO: task syz-executor.0:16395 blocked for more than 143 seconds.
      Not tainted 5.13.0-rc3-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:syz-executor.0  state:D stack:25952 pid:16395 ppid: 16156 flags:0x00004004
Call Trace:
 context_switch kernel/sched/core.c:4339 [inline]
 __schedule+0x916/0x23e0 kernel/sched/core.c:5147
 schedule+0xcf/0x270 kernel/sched/core.c:5226
 rwsem_down_write_slowpath+0x7e5/0x1200 kernel/locking/rwsem.c:1106
 __down_write_common kernel/locking/rwsem.c:1261 [inline]
 __down_write_common kernel/locking/rwsem.c:1258 [inline]
 __down_write kernel/locking/rwsem.c:1270 [inline]
 down_write+0x137/0x150 kernel/locking/rwsem.c:1407
 register_netdevice_notifier+0x1e/0x260 net/core/dev.c:1902
 bcm_init+0x1a3/0x210 net/can/bcm.c:1451
 can_create+0x27c/0x4d0 net/can/af_can.c:168
 __sock_create+0x3de/0x780 net/socket.c:1408
 sock_create net/socket.c:1459 [inline]
 __sys_socket+0xef/0x200 net/socket.c:1501
 __do_sys_socket net/socket.c:1510 [inline]
 __se_sys_socket net/socket.c:1508 [inline]
 __x64_sys_socket+0x6f/0xb0 net/socket.c:1508
 do_syscall_64+0x3a/0xb0 arch/x86/entry/common.c:47
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x4665d9
RSP: 002b:00007f7e1ffa7188 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
RAX: ffffffffffffffda RBX: 000000000056bf80 RCX: 00000000004665d9
RDX: 0000000000000002 RSI: 0000000000000002 RDI: 000000000000001d
RBP: 00000000004bfcb9 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 000000000056bf80
R13: 00007ffc744b4b1f R14: 00007f7e1ffa7300 R15: 0000000000022000
INFO: task syz-executor.0:16400 blocked for more than 143 seconds.
      Not tainted 5.13.0-rc3-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:syz-executor.0  state:D stack:29408 pid:16400 ppid: 16156 flags:0x00000004
Call Trace:
 context_switch kernel/sched/core.c:4339 [inline]
 __schedule+0x916/0x23e0 kernel/sched/core.c:5147
 schedule+0xcf/0x270 kernel/sched/core.c:5226
 rwsem_down_write_slowpath+0x7e5/0x1200 kernel/locking/rwsem.c:1106
 __down_write_common kernel/locking/rwsem.c:1261 [inline]
 __down_write_common kernel/locking/rwsem.c:1258 [inline]
 __down_write kernel/locking/rwsem.c:1270 [inline]
 down_write+0x137/0x150 kernel/locking/rwsem.c:1407
 register_netdevice_notifier+0x1e/0x260 net/core/dev.c:1902
 bcm_init+0x1a3/0x210 net/can/bcm.c:1451
 can_create+0x27c/0x4d0 net/can/af_can.c:168
 __sock_create+0x3de/0x780 net/socket.c:1408
 sock_create net/socket.c:1459 [inline]
 __sys_socket+0xef/0x200 net/socket.c:1501
 __do_sys_socket net/socket.c:1510 [inline]
 __se_sys_socket net/socket.c:1508 [inline]
 __x64_sys_socket+0x6f/0xb0 net/socket.c:1508
 do_syscall_64+0x3a/0xb0 arch/x86/entry/common.c:47
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x4665d9
RSP: 002b:00007f7e1ff44188 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
RAX: ffffffffffffffda RBX: 000000000056c1a8 RCX: 00000000004665d9
RDX: 0000000000000002 RSI: 0000000000000002 RDI: 000000000000001d
RBP: 00000000004bfcb9 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 000000000056c1a8
R13: 00007ffc744b4b1f R14: 00007f7e1ff44300 R15: 0000000000022000

Showing all locks held in the system:
1 lock held by khungtaskd/1627:
 #0: ffffffff8bf79320 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x53/0x260 kernel/locking/lockdep.c:6333
1 lock held by in:imklog/8277:
 #0: ffff888030e12870 (&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0xe9/0x100 fs/file.c:974
3 locks held by kworker/u4:2/14373:
1 lock held by syz-executor.0/16395:
 #0: ffffffff8d691f10 (pernet_ops_rwsem){++++}-{3:3}, at: register_netdevice_notifier+0x1e/0x260 net/core/dev.c:1902
1 lock held by syz-executor.0/16400:
 #0: ffffffff8d691f10 (pernet_ops_rwsem){++++}-{3:3}, at: register_netdevice_notifier+0x1e/0x260 net/core/dev.c:1902

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1627 Comm: khungtaskd Not tainted 5.13.0-rc3-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:79 [inline]
 dump_stack+0x141/0x1d7 lib/dump_stack.c:120
 nmi_cpu_backtrace.cold+0x44/0xd7 lib/nmi_backtrace.c:105
 nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:209 [inline]
 watchdog+0xd48/0xfb0 kernel/hung_task.c:294
 kthread+0x3b1/0x4a0 kernel/kthread.c:313
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:294
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 14373 Comm: kworker/u4:2 Not tainted 5.13.0-rc3-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Workqueue: netns cleanup_net
RIP: 0010:__sanitizer_cov_trace_pc+0x37/0x60 kernel/kcov.c:197
Code: 81 e1 00 01 00 00 65 48 8b 14 25 00 f0 01 00 a9 00 01 ff 00 74 0e 85 c9 74 35 8b 82 3c 15 00 00 85 c0 74 2b 8b 82 18 15 00 00 <83> f8 02 75 20 48 8b 8a 20 15 00 00 8b 92 1c 15 00 00 48 8b 01 48
RSP: 0018:ffffc900019afb58 EFLAGS: 00000046
RAX: 0000000000000000 RBX: 0000000000000200 RCX: 0000000000000000
RDX: ffff8880286d9c40 RSI: ffffffff8145d523 RDI: 0000000000000003
RBP: ffffffff874d2c23 R08: 0000000000000000 R09: ffffffff8bc703c3
R10: ffffffff817ae39d R11: 0000000000000000 R12: ffffffff8bc703c0
R13: 000000000000dee5 R14: 0000000000000000 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff8880b9d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005622c9273cd8 CR3: 00000000137ea000 CR4: 0000000000350ee0
Call Trace:
 __local_bh_enable_ip+0xc3/0x120 kernel/softirq.c:366
 local_bh_enable include/linux/bottom_half.h:32 [inline]
 get_next_corpse net/netfilter/nf_conntrack_core.c:2237 [inline]
 nf_ct_iterate_cleanup+0x15a/0x450 net/netfilter/nf_conntrack_core.c:2260
 nf_conntrack_cleanup_net_list+0x184/0x4f0 net/netfilter/nf_conntrack_core.c:2454
 ops_exit_list+0x10d/0x160 net/core/net_namespace.c:178
 cleanup_net+0x4ea/0xb10 net/core/net_namespace.c:595
 process_one_work+0x98d/0x1600 kernel/workqueue.c:2276
 worker_thread+0x64c/0x1120 kernel/workqueue.c:2422
 kthread+0x3b1/0x4a0 kernel/kthread.c:313
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:294

Crashes (10555):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Title
ci-upstream-kasan-gce-root 2021/05/27 08:24 upstream 7ac3a1c1ae51 858ea628 .config log report syz INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/06/19 05:27 upstream b1edae0d5f2e aba2b2fb .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/06/19 02:07 upstream b1edae0d5f2e aba2b2fb .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/06/18 03:22 upstream fd0aa1a4567d aba2b2fb .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/16 10:26 upstream 94f0b2d4a1d0 990d3cbe .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/15 13:00 upstream 009c9aa5be65 58636922 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/14 12:18 upstream 009c9aa5be65 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/13 04:43 upstream 8ecfa36cd4db 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/06/12 15:30 upstream ad347abe4a98 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/11 12:17 upstream 06af8679449d 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/06/11 10:52 upstream 06af8679449d 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/06/10 03:25 upstream cd1245d75ce9 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/06/09 16:40 upstream 368094df48e6 84fe5d96 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce 2021/06/09 11:53 upstream 368094df48e6 5c2fe346 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/08 21:38 upstream 4c8684fe555e b718257f .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/06/05 19:01 upstream e5220dd16778 500c2339 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/06/05 17:10 upstream 9d32fa5d74b1 500c2339 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/05 00:16 upstream 16f0596fc1d7 966a236b .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/06/04 14:31 upstream f88cd3fb9df2 966a236b .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce 2021/06/04 10:41 upstream f88cd3fb9df2 0740de69 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/06/03 02:57 upstream 324c92e5e0ee 0740de69 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/02 05:07 upstream 231bc5390667 032639db .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/06/01 00:04 upstream c2131f7e73c9 032639db .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/05/31 22:50 upstream c2131f7e73c9 032639db .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/05/31 14:59 upstream 8124c8a6b353 032639db .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/05/31 13:26 upstream 8124c8a6b353 032639db .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/05/31 05:04 upstream 8124c8a6b353 325a8dab .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/05/30 16:32 upstream b90e90f40b4f 325a8dab .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-smack-root 2021/05/30 14:53 upstream b90e90f40b4f 325a8dab .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/05/29 19:19 upstream 6799d4f2da49 325a8dab .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/05/29 00:11 upstream 5ff2756afde0 858ea628 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/05/27 14:47 upstream d7c5303fbc8a 858ea628 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-selinux-root 2021/05/27 01:45 upstream 7ac3a1c1ae51 858ea628 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-386 2021/05/06 13:42 upstream d2b6f8a17919 06c27ff5 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-this-kasan-gce 2021/06/13 21:47 net f4cdcae03f9c 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-bpf-kasan-gce 2021/06/13 17:11 bpf 11fc79fc9f2e 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-this-kasan-gce 2021/06/06 10:14 net 3822d0670c9d 500c2339 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-this-kasan-gce 2021/06/04 00:19 net 261ba78cc364 0740de69 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/18 10:49 net-next 8fe088bd4fd1 aba2b2fb .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/16 23:29 net-next 0c33795231bf aba2b2fb .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/15 10:58 net-next 89212e160b81 58636922 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/15 09:13 net-next 2d7ff2d83cac 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/12 20:59 net-next 02b0bb51a8da 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/12 12:33 net-next 1f1aa3fe0214 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/12 00:35 net-next 1f1aa3fe0214 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/11 18:53 net-next 76cf404c40ae 1ba81399 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/08 06:24 net-next dc8cf7550a70 b718257f .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/07 22:05 net-next 1a42624aecba e59537be .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/07 12:12 net-next 1a42624aecba e59537be .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/07 07:25 net-next 1a42624aecba 500c2339 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/05 04:34 net-next 1a42624aecba 500c2339 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/03 14:06 net-next 270d47dc1fc4 0740de69 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/02 11:59 net-next 5fe8e519e44f 0740de69 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/06/01 06:26 net-next e099f3e8b71c 032639db .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/05/31 02:06 net-next d3f2c48de7b8 325a8dab .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/05/30 02:33 net-next 015dbf5662fd 325a8dab .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/05/29 06:40 net-next 38e9673ce08f 858ea628 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/05/28 18:59 net-next af9207adb6d9 858ea628 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-net-kasan-gce 2021/05/28 13:26 net-next af9207adb6d9 858ea628 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-bpf-next-kasan-gce 2021/05/22 08:13 bpf-next a49e72b3bda7 3c7fef33 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-linux-next-kasan-gce-root 2021/05/05 13:52 linux-next 29955e0289b3 06c27ff5 .config log report info INFO: task hung in register_netdevice_notifier
ci-upstream-kasan-gce-root 2021/01/17 03:22 upstream 0da0a8a0a0e1 65a7a854 .config log report info
ci-upstream-kasan-gce-root 2019/10/22 21:33 upstream 3b7c59a1950c 5681358a .config log report
ci-upstream-linux-next-kasan-gce-root 2018/08/05 01:50 linux-next 116b181bb646 3476a2df .config log report