syzbot


INFO: task hung in addrconf_verify_work (3)

Status: fixed on 2020/11/16 12:12
Fix commit: 0fedc63fadf0 net_sched: commit action insertions together
First crash: 1658d, last: 1437d
Cause bisection: introduced by (bisect log) :
commit 0fedc63fadf0404a729e73a35349481c8009c02f
Author: Cong Wang <xiyou.wangcong@gmail.com>
Date: Wed Sep 23 03:56:24 2020 +0000

  net_sched: commit action insertions together

Crash: INFO: task hung in switchdev_deferred_process_work (log)
Repro: C syz .config
  
Similar bugs (21)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
android-49 INFO: task hung in addrconf_verify_work 18 1834d 2006d 0/3 auto-closed as invalid on 2020/01/31 12:44
linux-6.1 INFO: task hung in addrconf_verify_work (2) 44 34d 255d 0/3 upstream: reported on 2024/01/29 22:05
linux-4.19 INFO: task hung in addrconf_verify_work (5) 3 820d 860d 0/1 auto-obsoleted due to no activity on 2022/11/10 09:18
linux-4.19 INFO: task hung in addrconf_verify_work (6) C error 4 602d 661d 0/1 upstream: reported C repro on 2022/12/19 15:22
linux-4.19 INFO: task hung in addrconf_verify_work (3) 1 1307d 1307d 0/1 auto-closed as invalid on 2021/07/11 07:19
linux-4.19 INFO: task hung in addrconf_verify_work (4) 6 1002d 1088d 0/1 auto-closed as invalid on 2022/05/13 00:19
linux-4.14 INFO: task hung in addrconf_verify_work (2) C error 7 600d 1443d 0/1 upstream: reported C repro on 2020/10/28 05:47
upstream INFO: task hung in addrconf_verify_work (2) net C 22 1823d 1823d 13/28 fixed on 2019/11/04 14:50
linux-4.19 INFO: task hung in addrconf_verify_work (2) 2 1447d 1537d 0/1 auto-closed as invalid on 2021/02/21 08:05
linux-5.15 INFO: task hung in addrconf_verify_work origin:upstream missing-backport C done 53 100d 143d 0/3 upstream: reported C repro on 2024/05/20 18:55
android-414 INFO: task hung in addrconf_verify_work C 6 1823d 2009d 0/1 public: reported C repro on 2019/04/12 00:01
upstream INFO: task hung in addrconf_verify_work (8) net C error 1294 93d 297d 26/28 fixed on 2024/07/09 19:14
android-44 INFO: task hung in addrconf_verify_work 3 2340d 2369d 0/2 auto-closed as invalid on 2019/02/22 14:29
linux-4.19 INFO: task hung in addrconf_verify_work 1 1667d 1667d 0/1 auto-closed as invalid on 2020/07/16 23:17
upstream INFO: task hung in addrconf_verify_work (5) net C done done 68 1015d 1107d 0/28 closed as invalid on 2022/02/01 17:39
upstream INFO: task hung in addrconf_verify_work (7) netfilter C error 64 316d 463d 0/28 closed as invalid on 2023/12/01 14:19
linux-6.1 INFO: task hung in addrconf_verify_work 2 525d 576d 0/3 auto-obsoleted due to no activity on 2023/08/23 09:09
linux-4.14 INFO: task hung in addrconf_verify_work 4 1592d 1664d 0/1 auto-closed as invalid on 2020/09/29 04:19
upstream INFO: task hung in addrconf_verify_work net C 2 2390d 2390d 0/28 closed as invalid on 2018/03/27 11:14
upstream INFO: task hung in addrconf_verify_work (4) C done 132 1328d 1416d 20/28 fixed on 2021/04/09 19:46
upstream INFO: task hung in addrconf_verify_work (6) C done 86 598d 835d 22/28 fixed on 2023/02/24 13:51

Sample crash report:
INFO: task kworker/0:0:6880 blocked for more than 143 seconds.
      Not tainted 5.9.0-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/0:0     state:D stack:29440 pid: 6880 ppid:     2 flags:0x00004000
Workqueue: ipv6_addrconf addrconf_verify_work
Call Trace:
 context_switch kernel/sched/core.c:3778 [inline]
 __schedule+0xec9/0x2280 kernel/sched/core.c:4527
 schedule+0xd0/0x2a0 kernel/sched/core.c:4602
 schedule_preempt_disabled+0xf/0x20 kernel/sched/core.c:4661
 __mutex_lock_common kernel/locking/mutex.c:1033 [inline]
 __mutex_lock+0x3e2/0x10e0 kernel/locking/mutex.c:1103
 addrconf_verify_work+0xa/0x20 net/ipv6/addrconf.c:4568
 process_one_work+0x94c/0x1670 kernel/workqueue.c:2269
 worker_thread+0x64c/0x1120 kernel/workqueue.c:2415
 kthread+0x3b5/0x4a0 kernel/kthread.c:292
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:294

Showing all locks held in the system:
1 lock held by khungtaskd/1174:
 #0: ffffffff8a067ec0 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x53/0x260 kernel/locking/lockdep.c:5852
1 lock held by in:imklog/6562:
 #0: ffff8880961b48f0 (&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0xe9/0x100 fs/file.c:930
3 locks held by kworker/0:0/6880:
 #0: ffff88809a304538 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff88809a304538 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: atomic64_set include/asm-generic/atomic-instrumented.h:856 [inline]
 #0: ffff88809a304538 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: atomic_long_set include/asm-generic/atomic-long.h:41 [inline]
 #0: ffff88809a304538 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:616 [inline]
 #0: ffff88809a304538 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:643 [inline]
 #0: ffff88809a304538 ((wq_completion)ipv6_addrconf){+.+.}-{0:0}, at: process_one_work+0x82b/0x1670 kernel/workqueue.c:2240
 #1: ffffc90005637da8 ((addr_chk_work).work){+.+.}-{0:0}, at: process_one_work+0x85f/0x1670 kernel/workqueue.c:2244
 #2: ffffffff8b150908 (rtnl_mutex){+.+.}-{3:3}, at: addrconf_verify_work+0xa/0x20 net/ipv6/addrconf.c:4568
1 lock held by syz-executor433/6910:

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1174 Comm: khungtaskd Not tainted 5.9.0-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x198/0x1fd lib/dump_stack.c:118
 nmi_cpu_backtrace.cold+0x70/0xb1 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x1b3/0x223 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:209 [inline]
 watchdog+0xd7d/0x1000 kernel/hung_task.c:295
 kthread+0x3b5/0x4a0 kernel/kthread.c:292
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:294
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 6910 Comm: syz-executor433 Not tainted 5.9.0-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:arch_local_save_flags arch/x86/include/asm/paravirt.h:765 [inline]
RIP: 0010:arch_local_irq_save+0x28/0x90 arch/x86/include/asm/paravirt.h:787
Code: 00 00 48 c7 c0 60 6b fc 89 41 54 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00 75 4a 48 83 3d cb 4a a1 08 00 74 3c 9c <58> 0f 1f 44 00 00 48 ba 00 00 00 00 00 fc ff df 49 89 c4 48 c7 c0
RSP: 0018:ffffc900052a6a80 EFLAGS: 00000286
RAX: 1ffffffff13f8d6c RBX: 0000000000000000 RCX: ffffffff815c09ee
RDX: dffffc0000000000 RSI: 00000000ffffffff RDI: ffffffff8a067e00
RBP: ffff8880943a2480 R08: 0000000000000000 R09: ffffffff8b5996cf
R10: fffffbfff16b32d9 R11: 0000000000000000 R12: ffffffff8a067e00
R13: ffff8880943a2d68 R14: 0000000000000000 R15: 0000000000000001
FS:  0000000000770880(0000) GS:ffff8880ae500000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8a15f60000 CR3: 00000000902dd000 CR4: 00000000001506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 0.000 msecs

Crashes (75):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/10/13 05:13 upstream bbf5c979011a d32b0bbf .config console log report syz C ci-upstream-kasan-gce
2020/10/10 15:15 upstream 6f2f486d57c4 93817d89 .config console log report syz C ci-upstream-kasan-gce
2020/10/07 12:09 upstream c85fb28b6f99 1880b4a9 .config console log report syz C ci-upstream-kasan-gce-selinux-root
2020/10/07 06:15 upstream c85fb28b6f99 1880b4a9 .config console log report syz C ci-upstream-kasan-gce
2020/10/06 20:46 upstream 7575fdda569b 1880b4a9 .config console log report syz C ci-upstream-kasan-gce-selinux-root
2020/10/06 20:28 upstream 7575fdda569b 1880b4a9 .config console log report syz C ci-upstream-kasan-gce-selinux-root
2020/10/06 16:59 upstream 7575fdda569b 1880b4a9 .config console log report syz C ci-upstream-kasan-gce
2020/10/06 14:10 upstream 7575fdda569b 1880b4a9 .config console log report syz C ci-upstream-kasan-gce
2020/11/03 11:44 upstream 495023e4e49e cba33199 .config console log report syz C ci-upstream-kasan-gce-386
2020/10/08 00:29 upstream c85fb28b6f99 1880b4a9 .config console log report syz C ci-upstream-kasan-gce-386
2020/10/07 14:33 upstream c85fb28b6f99 1880b4a9 .config console log report syz C ci-upstream-kasan-gce-386
2020/10/06 12:25 upstream 7575fdda569b 1880b4a9 .config console log report syz C ci-upstream-kasan-gce-386
2020/10/31 08:09 net-old 2b94f5266c84 18e33098 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/17 23:51 net-old f355a55f8202 fea47c01 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/14 06:34 net-old 254941f32370 fc7735a2 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/12 01:10 net-old 874fb9e2ca94 4a77ae0b .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/11 17:12 net-old 874fb9e2ca94 4a77ae0b .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/11 05:25 net-old 7b50ee3dad25 4a77ae0b .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/11 00:52 net-old 7b50ee3dad25 4a77ae0b .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/10 14:27 net-old 923527dcb4d1 93817d89 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/09 23:31 net-old 3fdd47c3b40a d81b165e .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/09 05:59 net-old 28802e7c0c99 92390980 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/08 13:54 net-old d91dc434f2ba 1880b4a9 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/08 09:08 net-old d91dc434f2ba 1880b4a9 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/07 03:00 net-old 7575fdda569b 1880b4a9 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/06 21:17 net-old 7575fdda569b 1880b4a9 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/05 23:18 net-old 4296adc3e32f 1880b4a9 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/05 16:03 net-old 580e4273d7a8 5ef9c291 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/05 11:35 net-old 580e4273d7a8 5ef9c291 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/05 06:44 net-old 580e4273d7a8 5ef9c291 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/04 18:03 net-old 1f7e877c2051 5ef9c291 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/03 19:18 net-old ab0faf5f04e8 2653fa43 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/03 14:39 net-old ab0faf5f04e8 2653fa43 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/02 10:34 net-old bb13a800620c 9602ddf4 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/02 05:44 net-old bb13a800620c 9602ddf4 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/01 03:48 net-old 2b3e981a94d8 8516f6d3 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/09/30 22:56 net-old 2b3e981a94d8 8516f6d3 .config console log report syz C ci-upstream-net-this-kasan-gce
2020/09/30 02:13 net-old c92a79829c7c 5abc3f1a .config console log report syz C ci-upstream-net-this-kasan-gce
2020/10/30 21:12 net-next-old 37d38ece9b89 a6e3ac3b .config console log report syz C ci-upstream-net-kasan-gce
2020/10/25 17:36 net-next-old 3cb12d27ff65 a1839e81 .config console log report syz C ci-upstream-net-kasan-gce
2020/10/11 19:44 net-next-old df41c19abbea 4a77ae0b .config console log report syz C ci-upstream-net-kasan-gce
2020/10/11 19:39 net-next-old df41c19abbea 4a77ae0b .config console log report syz C ci-upstream-net-kasan-gce
2020/10/09 23:45 net-next-old 036dfd8322be d81b165e .config console log report syz C ci-upstream-net-kasan-gce
2020/10/08 21:43 net-next-old 9faebeb2d800 92390980 .config console log report syz C ci-upstream-net-kasan-gce
2020/10/08 12:12 net-next-old 9faebeb2d800 1880b4a9 .config console log report syz C ci-upstream-net-kasan-gce
2020/10/08 07:34 net-next-old 9faebeb2d800 1880b4a9 .config console log report syz C ci-upstream-net-kasan-gce
2020/10/07 09:56 net-next-old 9faebeb2d800 1880b4a9 .config console log report syz C ci-upstream-net-kasan-gce
2020/10/08 11:23 upstream c85fb28b6f99 1880b4a9 .config console log report info ci-upstream-kasan-gce
2020/10/07 18:32 upstream c85fb28b6f99 1880b4a9 .config console log report info ci-upstream-kasan-gce-root
2020/10/06 01:31 upstream 7575fdda569b 1880b4a9 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/08/27 03:21 upstream 15bc20c6af4c 318430cb .config console log report ci-upstream-kasan-gce
2020/08/17 17:35 upstream 9123e3a74ec7 424dd8e7 .config console log report ci-upstream-kasan-gce-selinux-root
2020/06/27 05:19 upstream 1590a2e1c681 ffec44b5 .config console log report ci-upstream-kasan-gce-root
2020/05/10 03:46 upstream 1d3962ae3b3d 8742a2b9 .config console log report ci-upstream-kasan-gce-selinux-root
2020/05/08 21:49 upstream 79dede78c057 2b98fdbc .config console log report ci-upstream-kasan-gce-selinux-root
2020/04/26 19:27 upstream edf17b283844 0ce7569e .config console log report ci-upstream-kasan-gce-selinux-root
2020/04/10 01:01 upstream 5d30bcacd91a a8c6a3f8 .config console log report ci-upstream-kasan-gce-root
2020/03/27 04:13 upstream 9420e8ade435 6d25c5a0 .config console log report ci-upstream-kasan-gce-smack-root
2020/07/12 07:57 upstream 0aea6d5c5be3 115e1930 .config console log report ci-upstream-kasan-gce-386
2020/10/05 05:26 net-old 580e4273d7a8 5ef9c291 .config console log report info ci-upstream-net-this-kasan-gce
2020/10/02 20:35 net-old ef9da46ddef0 4969d6ca .config console log report info ci-upstream-net-this-kasan-gce
2020/10/02 17:17 net-old ef9da46ddef0 4969d6ca .config console log report info ci-upstream-net-this-kasan-gce
2020/10/01 16:45 net-old a59cf619787e a9767fb2 .config console log report info ci-upstream-net-this-kasan-gce
2020/09/30 07:57 net-old c92a79829c7c 5abc3f1a .config console log report info ci-upstream-net-this-kasan-gce
2020/09/30 06:23 net-old c92a79829c7c 5abc3f1a .config console log report info ci-upstream-net-this-kasan-gce
2020/09/29 20:10 net-old c92a79829c7c 5abc3f1a .config console log report info ci-upstream-net-this-kasan-gce
2020/09/29 18:04 net-old 1aad8049909a 1b88c6d5 .config console log report info ci-upstream-net-this-kasan-gce
2020/09/29 09:33 net-old 1aad8049909a 1b88c6d5 .config console log report info ci-upstream-net-this-kasan-gce
2020/09/28 18:00 net-old 709a16be0593 6bfdbe89 .config console log report info ci-upstream-net-this-kasan-gce
2020/09/25 16:59 net-old ad2b9b0f8d01 4a006f63 .config console log report info ci-upstream-net-this-kasan-gce
2020/10/06 13:20 net-next-old 8b0308fe319b 1880b4a9 .config console log report info ci-upstream-net-kasan-gce
2020/10/06 12:45 net-next-old 8b0308fe319b 1880b4a9 .config console log report info ci-upstream-net-kasan-gce
2020/05/31 11:10 net-next-old 39884604b116 a0331e89 .config console log report ci-upstream-net-kasan-gce
2020/09/29 18:48 linux-next 49e7e3e905e4 1b88c6d5 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/09/28 21:05 linux-next 663b07a45f97 6bfdbe89 .config console log report info ci-upstream-linux-next-kasan-gce-root
* Struck through repros no longer work on HEAD.