syzbot


INFO: task hung in rollback_registered_many

Status: auto-closed as invalid on 2019/12/13 02:07
Reported-by: syzbot+83a0bdf3c737f5f6c420@syzkaller.appspotmail.com
First crash: 1754d, last: 1754d
Similar bugs (3)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: task hung in rollback_registered_many can 4 2065d 2072d 11/26 fixed on 2018/10/11 14:33
android-49 INFO: task hung in rollback_registered_many 2 1753d 1809d 0/3 auto-closed as invalid on 2019/12/13 20:53
upstream INFO: task hung in rollback_registered_many (2) net 37 1749d 2045d 0/26 closed as invalid on 2019/10/23 07:54

Sample crash report:
protocol 88fb is buggy, dev hsr_slave_1
protocol 88fb is buggy, dev hsr_slave_0
protocol 88fb is buggy, dev hsr_slave_1
protocol 88fb is buggy, dev hsr_slave_0
protocol 88fb is buggy, dev hsr_slave_1
INFO: task kworker/u4:5:11834 blocked for more than 140 seconds.
      Not tainted 4.19.66 #40
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/u4:5    D25568 11834      2 0x80000000
Workqueue: netns cleanup_net
Call Trace:
 context_switch kernel/sched/core.c:2826 [inline]
 __schedule+0x866/0x1dc0 kernel/sched/core.c:3474
 schedule+0x92/0x1c0 kernel/sched/core.c:3518
 _synchronize_rcu_expedited+0x4b2/0x7f0 kernel/rcu/tree_exp.h:686
 synchronize_rcu_expedited kernel/rcu/tree_exp.h:795 [inline]
 synchronize_rcu_expedited+0x35/0xb0 kernel/rcu/tree_exp.h:784
 synchronize_net+0x3b/0x60 net/core/dev.c:9068
 rollback_registered_many+0x57a/0xda0 net/core/dev.c:7992
 unregister_netdevice_many.part.0+0x1b/0x1f0 net/core/dev.c:9113
 unregister_netdevice_many+0x3b/0x50 net/core/dev.c:9112
 sit_exit_batch_net+0x560/0x750 net/ipv6/sit.c:1895
 ops_exit_list.isra.0+0xfc/0x150 net/core/net_namespace.c:156
 cleanup_net+0x3fb/0x960 net/core/net_namespace.c:552
 process_one_work+0x989/0x1750 kernel/workqueue.c:2153
 worker_thread+0x98/0xe40 kernel/workqueue.c:2296
 kthread+0x354/0x420 kernel/kthread.c:246
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
INFO: task syz-executor.3:21775 blocked for more than 140 seconds.
      Not tainted 4.19.66 #40
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.3  D28216 21775      1 0x00000004
Call Trace:
 context_switch kernel/sched/core.c:2826 [inline]
 __schedule+0x866/0x1dc0 kernel/sched/core.c:3474
 schedule+0x92/0x1c0 kernel/sched/core.c:3518
 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:3576
 __mutex_lock_common kernel/locking/mutex.c:1002 [inline]
 __mutex_lock+0x726/0x1300 kernel/locking/mutex.c:1072
 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1087
 rtnl_lock net/core/rtnetlink.c:77 [inline]
 rtnetlink_rcv_msg+0x40a/0xb00 net/core/rtnetlink.c:4744
 netlink_rcv_skb+0x17d/0x460 net/netlink/af_netlink.c:2454
 rtnetlink_rcv+0x1d/0x30 net/core/rtnetlink.c:4765
 netlink_unicast_kernel net/netlink/af_netlink.c:1317 [inline]
 netlink_unicast+0x537/0x720 net/netlink/af_netlink.c:1343
 netlink_sendmsg+0x8ae/0xd70 net/netlink/af_netlink.c:1908
 sock_sendmsg_nosec net/socket.c:622 [inline]
 sock_sendmsg+0xd7/0x130 net/socket.c:632
 __sys_sendto+0x262/0x380 net/socket.c:1787
 __do_sys_sendto net/socket.c:1799 [inline]
 __se_sys_sendto net/socket.c:1795 [inline]
 __x64_sys_sendto+0xe1/0x1a0 net/socket.c:1795
 do_syscall_64+0xfd/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x413673
Code: 29 94 24 80 00 00 00 0f 29 9c 24 90 00 00 00 0f 29 a4 24 a0 00 00 00 0f 29 ac 24 b0 00 00 00 0f 29 b4 24 c0 00 00 00 0f 29 bc <24> d0 00 00 00 48 8d 84 24 f0 00 00 00 c7 44 24 18 30 00 00 00 c7
RSP: 002b:00007ffdbedd38f8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000413673
RDX: 0000000000000028 RSI: 0000000000a70070 RDI: 0000000000000003
RBP: 00007ffdbedd3960 R08: 00007ffdbedd3900 R09: 000000000000000c
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000003
R13: 00007ffdbedd3c68 R14: 0000000000000000 R15: 0000000000000000

Showing all locks held in the system:
1 lock held by khungtaskd/1037:
 #0: 00000000e93798bf (rcu_read_lock){....}, at: debug_show_all_locks+0x5f/0x27e kernel/locking/lockdep.c:4435
1 lock held by udevd/3601:
1 lock held by rsyslogd/7466:
 #0: 00000000ca105b16 (&f->f_pos_lock){+.+.}, at: __fdget_pos+0xee/0x110 fs/file.c:767
2 locks held by getty/7588:
 #0: 00000000f5acdf4d (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:363
 #1: 00000000ed0d91aa (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7589:
 #0: 000000001cc081b7 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:363
 #1: 0000000086cd9770 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7590:
 #0: 00000000dc1f92ce (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:363
 #1: 00000000692cd7f1 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7591:
 #0: 00000000b34313b3 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:363
 #1: 00000000a0ba7749 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7592:
 #0: 00000000a5d418e7 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:363
 #1: 00000000843a12be (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7593:
 #0: 0000000051ab8045 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:363
 #1: 00000000fe62dbad (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7594:
 #0: 000000009ec46f0a (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:363
 #1: 00000000f6f36cb4 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
5 locks held by kworker/u4:5/11834:
 #0: 000000002106854e ((wq_completion)"%s""netns"){+.+.}, at: __write_once_size include/linux/compiler.h:220 [inline]
 #0: 000000002106854e ((wq_completion)"%s""netns"){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: 000000002106854e ((wq_completion)"%s""netns"){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:40 [inline]
 #0: 000000002106854e ((wq_completion)"%s""netns"){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:59 [inline]
 #0: 000000002106854e ((wq_completion)"%s""netns"){+.+.}, at: set_work_data kernel/workqueue.c:617 [inline]
 #0: 000000002106854e ((wq_completion)"%s""netns"){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline]
 #0: 000000002106854e ((wq_completion)"%s""netns"){+.+.}, at: process_one_work+0x87e/0x1750 kernel/workqueue.c:2124
 #1: 000000002b5f60f9 (net_cleanup_work){+.+.}, at: process_one_work+0x8b4/0x1750 kernel/workqueue.c:2128
 #2: 00000000c84de68d (pernet_ops_rwsem){++++}, at: cleanup_net+0xae/0x960 net/core/net_namespace.c:519
 #3: 0000000083cbecc2 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:77
 #4: 000000000f3e39cf (rcu_preempt_state.exp_mutex){+.+.}, at: exp_funnel_lock kernel/rcu/tree_exp.h:297 [inline]
 #4: 000000000f3e39cf (rcu_preempt_state.exp_mutex){+.+.}, at: _synchronize_rcu_expedited+0x59e/0x7f0 kernel/rcu/tree_exp.h:667
4 locks held by kworker/0:0/598:
3 locks held by kworker/1:3/5055:
 #0: 0000000024bd4f8a ((wq_completion)"events"){+.+.}, at: __write_once_size include/linux/compiler.h:220 [inline]
 #0: 0000000024bd4f8a ((wq_completion)"events"){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: 0000000024bd4f8a ((wq_completion)"events"){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:40 [inline]
 #0: 0000000024bd4f8a ((wq_completion)"events"){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:59 [inline]
 #0: 0000000024bd4f8a ((wq_completion)"events"){+.+.}, at: set_work_data kernel/workqueue.c:617 [inline]
 #0: 0000000024bd4f8a ((wq_completion)"events"){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline]
 #0: 0000000024bd4f8a ((wq_completion)"events"){+.+.}, at: process_one_work+0x87e/0x1750 kernel/workqueue.c:2124
 #1: 00000000d30f1ff0 (deferred_process_work){+.+.}, at: process_one_work+0x8b4/0x1750 kernel/workqueue.c:2128
 #2: 0000000083cbecc2 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:77
1 lock held by syz-executor.3/21586:
 #0: 000000001880d797 (&rtc->ops_lock){+.+.}, at: rtc_dev_ioctl+0xf3/0x980 drivers/rtc/rtc-dev.c:219
1 lock held by syz-executor.3/21775:
 #0: 0000000083cbecc2 (rtnl_mutex){+.+.}, at: rtnl_lock net/core/rtnetlink.c:77 [inline]
 #0: 0000000083cbecc2 (rtnl_mutex){+.+.}, at: rtnetlink_rcv_msg+0x40a/0xb00 net/core/rtnetlink.c:4744

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1037 Comm: khungtaskd Not tainted 4.19.66 #40
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x172/0x1f0 lib/dump_stack.c:113
 nmi_cpu_backtrace.cold+0x63/0xa4 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x1b0/0x1f8 lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:203 [inline]
 watchdog+0x9df/0xee0 kernel/hung_task.c:287
 kthread+0x354/0x420 kernel/kthread.c:246
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 3601 Comm: udevd Not tainted 4.19.66 #40
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:hlock_class kernel/locking/lockdep.c:145 [inline]
RIP: 0010:lookup_chain_cache_add kernel/locking/lockdep.c:2331 [inline]
RIP: 0010:validate_chain kernel/locking/lockdep.c:2386 [inline]
RIP: 0010:__lock_acquire+0xce9/0x49c0 kernel/locking/lockdep.c:3411
Code: 60 44 8b 5c 24 68 44 8b 4c 24 70 e9 db f8 ff ff 48 8b 94 24 80 00 00 00 48 b8 00 00 00 00 00 fc ff df 48 c1 ea 03 0f b6 04 02 <84> c0 74 21 3c 01 7f 1d 48 8b bc 24 80 00 00 00 4c 89 94 24 98 00
RSP: 0018:ffff888097cef980 EFLAGS: 00000802
RAX: 0000000000000000 RBX: 000000006b703790 RCX: 00000000708bc1ac
RDX: 1ffff11012f9c549 RSI: ffff888097ce2a00 RDI: 0000000000000000
RBP: ffff888097cefb50 R08: 0000000000000001 R09: 0000000000000001
R10: ffff888097ce2a28 R11: 0000000016eedddf R12: db096a8c5cb4e10e
R13: c788b8aa5e5b0eab R14: ffff888097ce2180 R15: 0000000000000000
FS:  00007f72261be7a0(0000) GS:ffff8880ae900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffffffff600400 CR3: 0000000096692000 CR4: 00000000001406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 lock_acquire+0x16f/0x3f0 kernel/locking/lockdep.c:3900
 __raw_spin_lock_irq include/linux/spinlock_api_smp.h:128 [inline]
 _raw_spin_lock_irq+0x60/0x80 kernel/locking/spinlock.c:160
 spin_lock_irq include/linux/spinlock.h:354 [inline]
 ep_scan_ready_list+0x15d/0xb20 fs/eventpoll.c:700
 ep_send_events fs/eventpoll.c:1713 [inline]
 ep_poll+0x3b4/0xd10 fs/eventpoll.c:1840
 do_epoll_wait+0x1b3/0x200 fs/eventpoll.c:2198
 __do_sys_epoll_wait fs/eventpoll.c:2208 [inline]
 __se_sys_epoll_wait fs/eventpoll.c:2205 [inline]
 __x64_sys_epoll_wait+0x97/0xf0 fs/eventpoll.c:2205
 do_syscall_64+0xfd/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x7f72258d2943
Code: 00 31 d2 48 29 c2 64 89 11 48 83 c8 ff eb ea 90 90 90 90 90 90 90 90 83 3d b5 dc 2a 00 00 75 13 49 89 ca b8 e8 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 34 c3 48 83 ec 08 e8 3b c4 00 00 48 89 04 24
RSP: 002b:00007ffe1de69da8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
RAX: ffffffffffffffda RBX: 0000000000000bb8 RCX: 00007f72258d2943
RDX: 0000000000000008 RSI: 00007ffe1de69ea0 RDI: 000000000000000a
RBP: 0000000000000001 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000bb8 R11: 0000000000000246 R12: 0000000000000003
R13: 0000000000000000 R14: 0000000000f490c0 R15: 0000000000f23030

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/08/15 02:06 linux-4.19.y 893af1c79e42 0d298d6b .config console log report ci2-linux-4-19
* Struck through repros no longer work on HEAD.