syzbot

 sign-in | mailing list | source | docs
🐞 Open [717]
🐞 Fixed [181]
🐞 Invalid [640]
≡ Crashes
Kernel Health Bugs/Month Bug Lifetimes Fuzzing
💬 Send us feedback

possible deadlock in sch_direct_xmit

Status: auto-closed as invalid on 2019/10/25 08:40
Reported-by: syzbot+1bcbf05728afc3e8922f@syzkaller.appspotmail.com
First crash: 2000d, last: 2000d
▶ ▼ Similar bugs (12)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 possible deadlock in sch_direct_xmit (2) origin:lts-only C done 19 5d00h 318d 0/3 upstream: reported C repro on 2024/01/09 18:28
android-44 possible deadlock in sch_direct_xmit C 240 1816d 2052d 0/2 public: reported C repro on 2019/04/11 08:44
upstream possible deadlock in sch_direct_xmit (2) net C done unreliable 109 494d 1669d 0/28 auto-obsoleted due to no activity on 2024/01/14 06:05
linux-4.19 possible deadlock in sch_direct_xmit (2) C error 15 637d 1154d 0/1 upstream: reported C repro on 2021/09/26 01:30
upstream possible deadlock in sch_direct_xmit net C done done 1548 1823d 2502d 15/28 fixed on 2020/04/17 19:57
linux-5.15 possible deadlock in sch_direct_xmit (2) origin:lts-only C error 13 26d 274d 0/3 upstream: reported C repro on 2024/02/22 19:25
upstream possible deadlock in sch_direct_xmit (4) net 1 209d 209d 25/28 fixed on 2024/06/05 13:52
linux-4.14 possible deadlock in sch_direct_xmit (2) 1 1833d 1833d 0/1 auto-closed as invalid on 2020/03/15 19:58
linux-4.19 possible deadlock in sch_direct_xmit 1 2001d 2001d 0/1 auto-closed as invalid on 2019/10/25 08:50
linux-5.15 possible deadlock in sch_direct_xmit 1 561d 561d 0/3 auto-obsoleted due to no activity on 2023/08/23 09:09
linux-6.1 possible deadlock in sch_direct_xmit 2 569d 608d 0/3 auto-obsoleted due to no activity on 2023/08/23 09:10
upstream possible deadlock in sch_direct_xmit (3) net 1 285d 285d 25/28 fixed on 2024/04/10 16:40

Sample crash report:
IPv6: ADDRCONF(NETDEV_CHANGE): hsr0: link becomes ready
IPv6: ADDRCONF(NETDEV_UP): vxcan1: link is not ready
8021q: adding VLAN 0 to HW filter on device batadv0
IPVS: sync thread started: state = BACKUP, mcast_ifn = erspan0, syncid = 3, id = 0
============================================
WARNING: possible recursive locking detected
4.14.123 #17 Not tainted
--------------------------------------------
ksoftirqd/1/17 is trying to acquire lock:
 (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] spin_lock include/linux/spinlock.h:317 [inline]
 (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] __netif_tx_lock include/linux/netdevice.h:3530 [inline]
 (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] sch_direct_xmit+0x1fc/0x550 net/sched/sch_generic.c:184

but task is already holding lock:
 (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] spin_lock include/linux/spinlock.h:317 [inline]
 (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] __netif_tx_lock include/linux/netdevice.h:3530 [inline]
 (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] sch_direct_xmit+0x1fc/0x550 net/sched/sch_generic.c:184

other info that might help us debug this:
 Possible unsafe locking scenario:

       CPU0
       ----
  lock(_xmit_ETHER#2);
  lock(_xmit_ETHER#2);

 *** DEADLOCK ***

 May be due to missing lock nesting notation

8 locks held by ksoftirqd/1/17:
 #0:  (((&in_dev->mr_ifc_timer))){+.-.}, at: [<ffffffff814f56d8>] lockdep_copy_map include/linux/lockdep.h:174 [inline]
 #0:  (((&in_dev->mr_ifc_timer))){+.-.}, at: [<ffffffff814f56d8>] call_timer_fn+0xc8/0x670 kernel/time/timer.c:1269
 #1:  (rcu_read_lock_bh){....}, at: [<ffffffff851ef916>] lwtunnel_xmit_redirect include/net/lwtunnel.h:92 [inline]
 #1:  (rcu_read_lock_bh){....}, at: [<ffffffff851ef916>] ip_finish_output2+0x256/0x14a0 net/ipv4/ip_output.c:213
 #2:  (rcu_read_lock_bh){....}, at: [<ffffffff84d33eb2>] __dev_queue_xmit+0x1e2/0x25e0 net/core/dev.c:3459
 #3:  (dev->qdisc_running_key ?: &qdisc_running_key){+...}, at: [<ffffffff84d362c8>] dev_queue_xmit+0x18/0x20 net/core/dev.c:3558
 #4:  (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] spin_lock include/linux/spinlock.h:317 [inline]
 #4:  (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] __netif_tx_lock include/linux/netdevice.h:3530 [inline]
 #4:  (_xmit_ETHER#2){+.-.}, at: [<ffffffff84e128bc>] sch_direct_xmit+0x1fc/0x550 net/sched/sch_generic.c:184
 #5:  (rcu_read_lock_bh){....}, at: [<ffffffff851ef916>] lwtunnel_xmit_redirect include/net/lwtunnel.h:92 [inline]
 #5:  (rcu_read_lock_bh){....}, at: [<ffffffff851ef916>] ip_finish_output2+0x256/0x14a0 net/ipv4/ip_output.c:213
 #6:  (rcu_read_lock_bh){....}, at: [<ffffffff84d33eb2>] __dev_queue_xmit+0x1e2/0x25e0 net/core/dev.c:3459
 #7:  (dev->qdisc_running_key ?: &qdisc_running_key){+...}, at: [<ffffffff84d362c8>] dev_queue_xmit+0x18/0x20 net/core/dev.c:3558

stack backtrace:
CPU: 1 PID: 17 Comm: ksoftirqd/1 Not tainted 4.14.123 #17
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:17 [inline]
 dump_stack+0x138/0x19c lib/dump_stack.c:53
 print_deadlock_bug kernel/locking/lockdep.c:1796 [inline]
 check_deadlock kernel/locking/lockdep.c:1843 [inline]
 validate_chain kernel/locking/lockdep.c:2444 [inline]
 __lock_acquire.cold+0x52a/0x8e2 kernel/locking/lockdep.c:3487
 lock_acquire+0x16f/0x430 kernel/locking/lockdep.c:3991
 __raw_spin_lock include/linux/spinlock_api_smp.h:142 [inline]
 _raw_spin_lock+0x2f/0x40 kernel/locking/spinlock.c:152
 spin_lock include/linux/spinlock.h:317 [inline]
 __netif_tx_lock include/linux/netdevice.h:3530 [inline]
 sch_direct_xmit+0x1fc/0x550 net/sched/sch_generic.c:184
 __dev_xmit_skb net/core/dev.c:3218 [inline]
 __dev_queue_xmit+0x1b6e/0x25e0 net/core/dev.c:3493
 dev_queue_xmit+0x18/0x20 net/core/dev.c:3558
 neigh_resolve_output net/core/neighbour.c:1361 [inline]
 neigh_resolve_output+0x4d8/0x870 net/core/neighbour.c:1341
 neigh_output include/net/neighbour.h:500 [inline]
 ip_finish_output2+0x766/0x14a0 net/ipv4/ip_output.c:229
 ip_finish_output+0x56d/0xc60 net/ipv4/ip_output.c:317
 NF_HOOK_COND include/linux/netfilter.h:239 [inline]
 ip_output+0x1e6/0x590 net/ipv4/ip_output.c:405
 dst_output include/net/dst.h:459 [inline]
 ip_local_out+0x97/0x170 net/ipv4/ip_output.c:124
 iptunnel_xmit+0x564/0x930 net/ipv4/ip_tunnel_core.c:91
 ip_tunnel_xmit+0xfd9/0x3189 net/ipv4/ip_tunnel.c:795
 __gre_xmit+0x4eb/0x890 net/ipv4/ip_gre.c:444
 erspan_xmit net/ipv4/ip_gre.c:750 [inline]
 erspan_xmit+0x441/0x11c0 net/ipv4/ip_gre.c:725
 __netdev_start_xmit include/linux/netdevice.h:4033 [inline]
 netdev_start_xmit include/linux/netdevice.h:4042 [inline]
 xmit_one net/core/dev.c:3009 [inline]
 dev_hard_start_xmit+0x18c/0x8b0 net/core/dev.c:3025
 sch_direct_xmit+0x27a/0x550 net/sched/sch_generic.c:186
 __dev_xmit_skb net/core/dev.c:3218 [inline]
 __dev_queue_xmit+0x1b6e/0x25e0 net/core/dev.c:3493
 dev_queue_xmit+0x18/0x20 net/core/dev.c:3558
 neigh_resolve_output net/core/neighbour.c:1361 [inline]
 neigh_resolve_output+0x4d8/0x870 net/core/neighbour.c:1341
 neigh_output include/net/neighbour.h:500 [inline]
 ip_finish_output2+0x766/0x14a0 net/ipv4/ip_output.c:229
 ip_finish_output+0x56d/0xc60 net/ipv4/ip_output.c:317
 NF_HOOK_COND include/linux/netfilter.h:239 [inline]
 ip_output+0x1e6/0x590 net/ipv4/ip_output.c:405
 dst_output include/net/dst.h:459 [inline]
 ip_local_out+0x97/0x170 net/ipv4/ip_output.c:124
 igmpv3_sendpack+0x1a2/0x2b0 net/ipv4/igmp.c:420
 igmpv3_send_cr net/ipv4/igmp.c:708 [inline]
 igmp_ifc_timer_expire+0x543/0x8b0 net/ipv4/igmp.c:796
 call_timer_fn+0x161/0x670 kernel/time/timer.c:1279
 expire_timers kernel/time/timer.c:1318 [inline]
 __run_timers kernel/time/timer.c:1634 [inline]
 __run_timers kernel/time/timer.c:1602 [inline]
 run_timer_softirq+0x5b4/0x1570 kernel/time/timer.c:1647
 __do_softirq+0x244/0x9a0 kernel/softirq.c:288
 run_ksoftirqd kernel/softirq.c:670 [inline]
 run_ksoftirqd+0x8c/0x1b0 kernel/softirq.c:662
 smpboot_thread_fn+0x5f4/0x960 kernel/smpboot.c:164
 kthread+0x319/0x430 kernel/kthread.c:232
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:404
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
IPVS: ftp: loaded support on port[0] = 21
NET: Registered protocol family 30
Failed to register TIPC socket type
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
kobject: 'loop0' (ffff8880a49377a0): kobject_uevent_env
kobject: 'loop0' (ffff8880a49377a0): fill_kobj_path: path = '/devices/virtual/block/loop0'
IPVS: ftp: loaded support on port[0] = 21
NET: Registered protocol family 30
Failed to register TIPC socket type
IPVS: ftp: loaded support on port[0] = 21
NET: Registered protocol family 30
Failed to register TIPC socket type
IPVS: ftp: loaded support on port[0] = 21
NET: Registered protocol family 30
Failed to register TIPC socket type
IPVS: ftp: loaded support on port[0] = 21
NET: Registered protocol family 30
Failed to register TIPC socket type
IPVS: ftp: loaded support on port[0] = 21
NET: Registered protocol family 30
Failed to register TIPC socket type

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/06/03 00:33 linux-4.14.y 8cb123988908 53c81ea5 .config console log report ci2-linux-4-14
* Struck through repros no longer work on HEAD.