syzbot


possible deadlock in sch_direct_xmit

Status: public: reported C repro on 2019/04/11 08:44
Reported-by: syzbot+ecda1e218cc594d9cd61@syzkaller.appspotmail.com
First crash: 2194d, last: 1604d
Similar bugs (11)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 possible deadlock in sch_direct_xmit (2) C 9 14d 106d 0/3 upstream: reported C repro on 2024/01/09 18:28
upstream possible deadlock in sch_direct_xmit (2) net C done unreliable 109 282d 1457d 0/26 auto-obsoleted due to no activity on 2024/01/14 06:05
linux-4.19 possible deadlock in sch_direct_xmit (2) C error 15 425d 942d 0/1 upstream: reported C repro on 2021/09/26 01:30
upstream possible deadlock in sch_direct_xmit net C done done 1548 1611d 2290d 15/26 fixed on 2020/04/17 19:57
linux-5.15 possible deadlock in sch_direct_xmit (2) 4 19h40m 62d 0/3 upstream: reported on 2024/02/22 19:25
linux-4.14 possible deadlock in sch_direct_xmit 1 1788d 1788d 0/1 auto-closed as invalid on 2019/10/25 08:40
linux-4.14 possible deadlock in sch_direct_xmit (2) 1 1621d 1621d 0/1 auto-closed as invalid on 2020/03/15 19:58
linux-4.19 possible deadlock in sch_direct_xmit 1 1789d 1789d 0/1 auto-closed as invalid on 2019/10/25 08:50
linux-5.15 possible deadlock in sch_direct_xmit 1 349d 349d 0/3 auto-obsoleted due to no activity on 2023/08/23 09:09
linux-6.1 possible deadlock in sch_direct_xmit 2 357d 396d 0/3 auto-obsoleted due to no activity on 2023/08/23 09:10
upstream possible deadlock in sch_direct_xmit (3) net 1 73d 73d 26/26 fixed on 2024/04/10 16:40

Sample crash report:
audit: type=1400 audit(1574924186.586:7): avc:  denied  { read } for  pid=2075 comm="syz-executor795" scontext=unconfined_u:system_r:insmod_t:s0-s0:c0.c1023 tcontext=unconfined_u:system_r:insmod_t:s0-s0:c0.c1023 tclass=netlink_generic_socket permissive=1
======================================================
[ INFO: possible circular locking dependency detected ]
4.4.174+ #4 Not tainted
-------------------------------------------------------
syz-executor795/2079 is trying to acquire lock:
 (_xmit_NETROM){+.-...}, at: [<ffffffff822b1b58>] spin_lock include/linux/spinlock.h:302 [inline]
 (_xmit_NETROM){+.-...}, at: [<ffffffff822b1b58>] __netif_tx_lock include/linux/netdevice.h:3306 [inline]
 (_xmit_NETROM){+.-...}, at: [<ffffffff822b1b58>] sch_direct_xmit+0x238/0x700 net/sched/sch_generic.c:163

but task is already holding lock:
 (&(&q->lock)->rlock){+.-...}, at: [<ffffffff8263b03c>] spin_lock include/linux/spinlock.h:302 [inline]
 (&(&q->lock)->rlock){+.-...}, at: [<ffffffff8263b03c>] ipv6_frag_rcv+0x6cc/0x51e0 net/ipv6/reassembly.c:528

which lock already depends on the new lock.


the existing dependency chain (in reverse order) is:

       [<ffffffff81205f6e>] lock_acquire+0x15e/0x450 kernel/locking/lockdep.c:3592
       [<ffffffff82717e50>] __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:112 [inline]
       [<ffffffff82717e50>] _raw_spin_lock_irqsave+0x50/0x70 kernel/locking/spinlock.c:159
       [<ffffffff81b46dac>] depot_save_stack+0x20c/0x5f0 lib/stackdepot.c:252
       [<ffffffff81483f86>] save_stack mm/kasan/kasan.c:518 [inline]
       [<ffffffff81483f86>] set_track mm/kasan/kasan.c:524 [inline]
       [<ffffffff81483f86>] kasan_kmalloc.part.0+0xc6/0xf0 mm/kasan/kasan.c:616
       [<ffffffff81484197>] kasan_kmalloc+0xb7/0xd0 mm/kasan/kasan.c:601
       [<ffffffff8148475f>] kasan_slab_alloc+0xf/0x20 mm/kasan/kasan.c:554
       [<ffffffff8147fe9c>] slab_post_alloc_hook mm/slub.c:1349 [inline]
       [<ffffffff8147fe9c>] slab_alloc_node mm/slub.c:2615 [inline]
       [<ffffffff8147fe9c>] slab_alloc mm/slub.c:2623 [inline]
       [<ffffffff8147fe9c>] kmem_cache_alloc+0xdc/0x2c0 mm/slub.c:2628
       [<ffffffff823b4b55>] inet_getpeer+0x1525/0x1ce0 net/ipv4/inetpeer.c:444
       [<ffffffff823b9f82>] inet_getpeer_v4 include/net/inetpeer.h:116 [inline]
       [<ffffffff823b9f82>] ip4_frag_init+0x2a2/0x310 net/ipv4/ip_fragment.c:146
       [<ffffffff824e177c>] inet_frag_alloc net/ipv4/inet_fragment.c:180 [inline]
       [<ffffffff824e177c>] inet_frag_create+0x1ac/0x14e0 net/ipv4/inet_fragment.c:197
       [<ffffffff824e30fd>] inet_frag_find+0x64d/0x880 net/ipv4/inet_fragment.c:224
       [<ffffffff823ba2eb>] ip_find net/ipv4/ip_fragment.c:284 [inline]
       [<ffffffff823ba2eb>] ip_defrag+0x2fb/0x3b70 net/ipv4/ip_fragment.c:686
       [<ffffffff823bdf36>] ip_check_defrag net/ipv4/ip_fragment.c:738 [inline]
       [<ffffffff823bdf36>] ip_check_defrag+0x3d6/0x5b0 net/ipv4/ip_fragment.c:705
       [<ffffffff826dfb3e>] packet_rcv_fanout+0x51e/0x5f0 net/packet/af_packet.c:1458
       [<ffffffff82244f04>] dev_queue_xmit_nit net/core/dev.c:1935 [inline]
       [<ffffffff82244f04>] xmit_one net/core/dev.c:2777 [inline]
       [<ffffffff82244f04>] dev_hard_start_xmit+0x654/0x11e0 net/core/dev.c:2797
       [<ffffffff822b1bd6>] sch_direct_xmit+0x2b6/0x700 net/sched/sch_generic.c:165
       [<ffffffff82246aa4>] __dev_xmit_skb net/core/dev.c:2979 [inline]
       [<ffffffff82246aa4>] __dev_queue_xmit+0xd24/0x1bb0 net/core/dev.c:3197
       [<ffffffff82247948>] dev_queue_xmit+0x18/0x20 net/core/dev.c:3263
       [<ffffffff822677e0>] neigh_resolve_output+0x4a0/0x7a0 net/core/neighbour.c:1329
       [<ffffffff823c5412>] dst_neigh_output include/net/dst.h:461 [inline]
       [<ffffffff823c5412>] ip_finish_output2+0x6a2/0x1280 net/ipv4/ip_output.c:213
       [<ffffffff823c805c>] ip_do_fragment+0x187c/0x1f70 net/ipv4/ip_output.c:635
       [<ffffffff823cbd7b>] ip_fragment.constprop.0+0x14b/0x200 net/ipv4/ip_output.c:505
       [<ffffffff823cc1e9>] ip_finish_output+0x3b9/0xc60 net/ipv4/ip_output.c:286
       [<ffffffff823cf9f1>] NF_HOOK_COND include/linux/netfilter.h:240 [inline]
       [<ffffffff823cf9f1>] ip_mc_output+0x251/0xae0 net/ipv4/ip_output.c:347
       [<ffffffff823cd21c>] dst_output include/net/dst.h:498 [inline]
       [<ffffffff823cd21c>] ip_local_out+0x9c/0x180 net/ipv4/ip_output.c:119
       [<ffffffff823d300e>] ip_send_skb+0x3e/0xc0 net/ipv4/ip_output.c:1453
       [<ffffffff82478ded>] udp_send_skb+0x4fd/0xc70 net/ipv4/udp.c:842
       [<ffffffff824795ae>] udp_push_pending_frames+0x4e/0xe0 net/ipv4/udp.c:870
       [<ffffffff8248084e>] udp_sendpage+0x2ae/0x410 net/ipv4/udp.c:1183
       [<ffffffff824aa083>] inet_sendpage+0x223/0x520 net/ipv4/af_inet.c:772
       [<ffffffff821d81b5>] kernel_sendpage+0x95/0xf0 net/socket.c:3320
       [<ffffffff821d829b>] sock_sendpage+0x8b/0xc0 net/socket.c:793
       [<ffffffff81530f1d>] pipe_to_sendpage+0x28d/0x3d0 fs/splice.c:724
       [<ffffffff81533b6e>] splice_from_pipe_feed fs/splice.c:776 [inline]
       [<ffffffff81533b6e>] __splice_from_pipe+0x37e/0x7a0 fs/splice.c:901
       [<ffffffff81536be8>] splice_from_pipe+0x108/0x170 fs/splice.c:936
       [<ffffffff81536c8c>] generic_splice_sendpage+0x3c/0x50 fs/splice.c:1109
       [<ffffffff81537d31>] do_splice_from fs/splice.c:1128 [inline]
       [<ffffffff81537d31>] do_splice fs/splice.c:1404 [inline]
       [<ffffffff81537d31>] SYSC_splice fs/splice.c:1707 [inline]
       [<ffffffff81537d31>] SyS_splice+0xd71/0x13a0 fs/splice.c:1690
       [<ffffffff82718ba1>] entry_SYSCALL_64_fastpath+0x1e/0x9a

       [<ffffffff81202d86>] check_prev_add kernel/locking/lockdep.c:1853 [inline]
       [<ffffffff81202d86>] check_prevs_add kernel/locking/lockdep.c:1958 [inline]
       [<ffffffff81202d86>] validate_chain kernel/locking/lockdep.c:2144 [inline]
       [<ffffffff81202d86>] __lock_acquire+0x37d6/0x4f50 kernel/locking/lockdep.c:3213
       [<ffffffff81205f6e>] lock_acquire+0x15e/0x450 kernel/locking/lockdep.c:3592
       [<ffffffff82717c98>] __raw_spin_lock include/linux/spinlock_api_smp.h:144 [inline]
       [<ffffffff82717c98>] _raw_spin_lock+0x38/0x50 kernel/locking/spinlock.c:151
       [<ffffffff822b1b58>] spin_lock include/linux/spinlock.h:302 [inline]
       [<ffffffff822b1b58>] __netif_tx_lock include/linux/netdevice.h:3306 [inline]
       [<ffffffff822b1b58>] sch_direct_xmit+0x238/0x700 net/sched/sch_generic.c:163
       [<ffffffff82246aa4>] __dev_xmit_skb net/core/dev.c:2979 [inline]
       [<ffffffff82246aa4>] __dev_queue_xmit+0xd24/0x1bb0 net/core/dev.c:3197
       [<ffffffff82247948>] dev_queue_xmit+0x18/0x20 net/core/dev.c:3263
       [<ffffffff822677e0>] neigh_resolve_output+0x4a0/0x7a0 net/core/neighbour.c:1329
       [<ffffffff8259f877>] dst_neigh_output include/net/dst.h:461 [inline]
       [<ffffffff8259f877>] ip6_finish_output2+0x9c7/0x1dc0 net/ipv6/ip6_output.c:113
       [<ffffffff825b0203>] ip6_finish_output+0x2f3/0x750 net/ipv6/ip6_output.c:131
       [<ffffffff825b0814>] NF_HOOK_COND include/linux/netfilter.h:240 [inline]
       [<ffffffff825b0814>] ip6_output+0x1b4/0x520 net/ipv6/ip6_output.c:145
       [<ffffffff826036dd>] dst_output include/net/dst.h:498 [inline]
       [<ffffffff826036dd>] NF_HOOK_THRESH include/linux/netfilter.h:226 [inline]
       [<ffffffff826036dd>] NF_HOOK include/linux/netfilter.h:249 [inline]
       [<ffffffff826036dd>] ndisc_send_skb+0x98d/0x1110 net/ipv6/ndisc.c:471
       [<ffffffff82606cef>] ndisc_send_ns+0x4bf/0x6b0 net/ipv6/ndisc.c:595
       [<ffffffff82607192>] ndisc_solicit+0x2b2/0x440 net/ipv6/ndisc.c:686
       [<ffffffff8225b508>] neigh_probe+0xc8/0x100 net/core/neighbour.c:871
       [<ffffffff8226699b>] __neigh_event_send+0x2ab/0xc50 net/core/neighbour.c:1027
       [<ffffffff8226792c>] neigh_event_send include/net/neighbour.h:431 [inline]
       [<ffffffff8226792c>] neigh_resolve_output+0x5ec/0x7a0 net/core/neighbour.c:1313
       [<ffffffff8259f877>] dst_neigh_output include/net/dst.h:461 [inline]
       [<ffffffff8259f877>] ip6_finish_output2+0x9c7/0x1dc0 net/ipv6/ip6_output.c:113
       [<ffffffff825b0203>] ip6_finish_output+0x2f3/0x750 net/ipv6/ip6_output.c:131
       [<ffffffff825b0814>] NF_HOOK_COND include/linux/netfilter.h:240 [inline]
       [<ffffffff825b0814>] ip6_output+0x1b4/0x520 net/ipv6/ip6_output.c:145
       [<ffffffff826bf66c>] dst_output include/net/dst.h:498 [inline]
       [<ffffffff826bf66c>] ip6_local_out+0x9c/0x180 net/ipv6/output_core.c:169
       [<ffffffff825b28c2>] ip6_send_skb+0xa2/0x340 net/ipv6/ip6_output.c:1725
       [<ffffffff825b2c1b>] ip6_push_pending_frames+0xbb/0xe0 net/ipv6/ip6_output.c:1745
       [<ffffffff82620f66>] icmpv6_push_pending_frames+0x336/0x530 net/ipv6/icmp.c:276
       [<ffffffff82622666>] icmp6_send+0x1506/0x1b40 net/ipv6/icmp.c:537
       [<ffffffff82624099>] icmpv6_param_prob+0x29/0x40 net/ipv6/icmp.c:551
       [<ffffffff8263e655>] ip6_frag_queue net/ipv6/reassembly.c:190 [inline]
       [<ffffffff8263e655>] ipv6_frag_rcv+0x3ce5/0x51e0 net/ipv6/reassembly.c:531
       [<ffffffff825b3c1d>] ip6_input_finish+0x57d/0x14f0 net/ipv6/ip6_input.c:248
       [<ffffffff825b66a8>] NF_HOOK_THRESH include/linux/netfilter.h:226 [inline]
       [<ffffffff825b66a8>] NF_HOOK include/linux/netfilter.h:249 [inline]
       [<ffffffff825b66a8>] ip6_input+0xf8/0x1f0 net/ipv6/ip6_input.c:280
       [<ffffffff825b317d>] dst_input include/net/dst.h:504 [inline]
       [<ffffffff825b317d>] ip6_rcv_finish+0x14d/0x670 net/ipv6/ip6_input.c:62
       [<ffffffff825b5b51>] NF_HOOK_THRESH include/linux/netfilter.h:226 [inline]
       [<ffffffff825b5b51>] NF_HOOK include/linux/netfilter.h:249 [inline]
       [<ffffffff825b5b51>] ipv6_rcv+0xfc1/0x1a20 net/ipv6/ip6_input.c:186
       [<ffffffff82230640>] __netif_receive_skb_core+0x1300/0x2950 net/core/dev.c:4041
       [<ffffffff82238bd8>] __netif_receive_skb+0x58/0x1c0 net/core/dev.c:4076
       [<ffffffff8223fec0>] process_backlog+0x200/0x630 net/core/dev.c:4673
       [<ffffffff8223f2f7>] napi_poll net/core/dev.c:4911 [inline]
       [<ffffffff8223f2f7>] net_rx_action+0x367/0xd30 net/core/dev.c:4976
       [<ffffffff8271bb16>] __do_softirq+0x226/0xa3f kernel/softirq.c:273
       [<ffffffff82719cdc>] do_softirq_own_stack+0x1c/0x30 arch/x86/entry/entry_64.S:956
       [<ffffffff810e1744>] do_softirq.part.0+0x54/0x60 kernel/softirq.c:317
       [<ffffffff810e18a8>] do_softirq+0x18/0x20 kernel/softirq.c:305
       [<ffffffff8222ec4b>] netif_rx_ni+0xeb/0x3b0 net/core/dev.c:3675
       [<ffffffff81e22f6f>] tun_get_user+0xdbf/0x2640 drivers/net/tun.c:1264
       [<ffffffff81e24a0a>] tun_chr_write_iter+0xda/0x190 drivers/net/tun.c:1283
       [<ffffffff81497941>] do_iter_readv_writev+0x141/0x1e0 fs/read_write.c:666
       [<ffffffff81498cf7>] do_readv_writev+0x387/0x6e0 fs/read_write.c:810
       [<ffffffff8149917d>] vfs_writev+0x7d/0xb0 fs/read_write.c:849
       [<ffffffff8149b5fc>] SYSC_writev fs/read_write.c:882 [inline]
       [<ffffffff8149b5fc>] SyS_writev+0xdc/0x260 fs/read_write.c:874
       [<ffffffff82718ba1>] entry_SYSCALL_64_fastpath+0x1e/0x9a

other info that might help us debug this:

 Possible unsafe locking scenario:

       CPU0                    CPU1
       ----                    ----
  lock(&(&q->lock)->rlock);
                               lock(_xmit_NETROM);
                               lock(&(&q->lock)->rlock);
  lock(_xmit_NETROM);

 *** DEADLOCK ***

9 locks held by syz-executor795/2079:
 #0:  (rcu_read_lock){......}, at: [<ffffffff8223fe5c>] __skb_unlink include/linux/skbuff.h:1648 [inline]
 #0:  (rcu_read_lock){......}, at: [<ffffffff8223fe5c>] __skb_dequeue include/linux/skbuff.h:1664 [inline]
 #0:  (rcu_read_lock){......}, at: [<ffffffff8223fe5c>] process_backlog+0x19c/0x630 net/core/dev.c:4670
 #1:  (rcu_read_lock){......}, at: [<ffffffff825b36a0>] ip6_input_finish+0x0/0x14f0 net/ipv6/ip6_input.c:55
 #2:  (&(&q->lock)->rlock){+.-...}, at: [<ffffffff8263b03c>] spin_lock include/linux/spinlock.h:302 [inline]
 #2:  (&(&q->lock)->rlock){+.-...}, at: [<ffffffff8263b03c>] ipv6_frag_rcv+0x6cc/0x51e0 net/ipv6/reassembly.c:528
 #3:  (slock-AF_INET6){+.....}, at: [<ffffffff8262191d>] spin_trylock include/linux/spinlock.h:312 [inline]
 #3:  (slock-AF_INET6){+.....}, at: [<ffffffff8262191d>] icmpv6_xmit_lock net/ipv6/icmp.c:120 [inline]
 #3:  (slock-AF_INET6){+.....}, at: [<ffffffff8262191d>] icmp6_send+0x7bd/0x1b40 net/ipv6/icmp.c:485
 #4:  (rcu_read_lock){......}, at: [<ffffffff826220a4>] icmp6_send+0xf44/0x1b40 net/ipv6/icmp.c:517
 #5:  (rcu_read_lock_bh){......}, at: [<ffffffff8259f091>] ip6_finish_output2+0x1e1/0x1dc0 net/ipv6/ip6_output.c:71
 #6:  (rcu_read_lock){......}, at: [<ffffffff826034c9>] ip6_nd_hdr net/ipv6/ndisc.c:427 [inline]
 #6:  (rcu_read_lock){......}, at: [<ffffffff826034c9>] ndisc_send_skb+0x779/0x1110 net/ipv6/ndisc.c:465
 #7:  (rcu_read_lock_bh){......}, at: [<ffffffff8259f091>] ip6_finish_output2+0x1e1/0x1dc0 net/ipv6/ip6_output.c:71
 #8:  (rcu_read_lock_bh){......}, at: [<ffffffff82245f57>] __dev_queue_xmit+0x1d7/0x1bb0 net/core/dev.c:3161

stack backtrace:
CPU: 1 PID: 2079 Comm: syz-executor795 Not tainted 4.4.174+ #4
 0000000000000000 c27725336b879830 ffff8801db7064e0 ffffffff81aad1a1
 ffffffff84057a80 ffff8801d4d5c740 ffffffff83ad40e0 ffffffff83ad47a0
 ffffffff83ad40e0 ffff8801db706530 ffffffff813abcda ffff8801db706610
Call Trace:
 <IRQ>  [<ffffffff81aad1a1>] __dump_stack lib/dump_stack.c:15 [inline]
 <IRQ>  [<ffffffff81aad1a1>] dump_stack+0xc1/0x120 lib/dump_stack.c:51
 [<ffffffff813abcda>] print_circular_bug.cold+0x2f7/0x44e kernel/locking/lockdep.c:1226
 [<ffffffff81202d86>] check_prev_add kernel/locking/lockdep.c:1853 [inline]
 [<ffffffff81202d86>] check_prevs_add kernel/locking/lockdep.c:1958 [inline]
 [<ffffffff81202d86>] validate_chain kernel/locking/lockdep.c:2144 [inline]
 [<ffffffff81202d86>] __lock_acquire+0x37d6/0x4f50 kernel/locking/lockdep.c:3213
 [<ffffffff81205f6e>] lock_acquire+0x15e/0x450 kernel/locking/lockdep.c:3592
 [<ffffffff82717c98>] __raw_spin_lock include/linux/spinlock_api_smp.h:144 [inline]
 [<ffffffff82717c98>] _raw_spin_lock+0x38/0x50 kernel/locking/spinlock.c:151
 [<ffffffff822b1b58>] sch_direc

Crashes (240):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/11/28 06:59 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 0d63f89c .config console log report syz C ci-android-44-kasan-gce
2019/10/21 09:07 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8c88c9c1 .config console log report syz C ci-android-44-kasan-gce
2019/10/19 09:24 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8c88c9c1 .config console log report syz C ci-android-44-kasan-gce
2019/10/05 20:44 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b f3f7d9c8 .config console log report syz C ci-android-44-kasan-gce
2019/09/27 03:30 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 2f1548bc .config console log report syz C ci-android-44-kasan-gce
2018/11/06 00:22 https://android.googlesource.com/kernel/common android-4.4 3411c22ecc5a 8bd6bd63 .config console log report syz C ci-android-44-kasan-gce
2018/07/21 01:37 https://android.googlesource.com/kernel/common android-4.4 1b37d68f4c82 af255b09 .config console log report syz C ci-android-44-kasan-gce
2018/06/18 18:58 https://android.googlesource.com/kernel/common android-4.4 07c01385fb82 45c54f75 .config console log report syz C ci-android-44-kasan-gce
2019/11/28 06:59 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 0d63f89c .config console log report syz C ci-android-44-kasan-gce-386
2019/10/21 09:08 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8c88c9c1 .config console log report syz C ci-android-44-kasan-gce-386
2019/10/19 09:24 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8c88c9c1 .config console log report syz C ci-android-44-kasan-gce-386
2019/10/05 21:13 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b f3f7d9c8 .config console log report syz C ci-android-44-kasan-gce-386
2019/09/27 03:31 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 2f1548bc .config console log report syz C ci-android-44-kasan-gce-386
2018/11/06 00:24 https://android.googlesource.com/kernel/common android-4.4 3411c22ecc5a 8bd6bd63 .config console log report syz C ci-android-44-kasan-gce-386
2018/07/21 01:37 https://android.googlesource.com/kernel/common android-4.4 1b37d68f4c82 af255b09 .config console log report syz ci-android-44-kasan-gce-386
2019/12/04 02:32 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b ae13a849 .config console log report ci-android-44-kasan-gce
2019/11/29 01:41 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 76357d6f .config console log report ci-android-44-kasan-gce
2019/11/28 22:19 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 46869e3e .config console log report ci-android-44-kasan-gce
2019/11/28 06:02 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 0d63f89c .config console log report ci-android-44-kasan-gce
2019/11/21 13:26 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8098ea0f .config console log report ci-android-44-kasan-gce
2019/11/12 03:06 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 048f2d49 .config console log report ci-android-44-kasan-gce
2019/10/09 17:47 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 312c6a5a .config console log report ci-android-44-kasan-gce
2019/10/04 11:09 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b fc17ba49 .config console log report ci-android-44-kasan-gce
2019/11/30 20:11 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 3a75be00 .config console log report ci-android-44-kasan-gce-386
2019/11/29 16:27 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b d29b9e84 .config console log report ci-android-44-kasan-gce-386
2019/11/29 06:02 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 76357d6f .config console log report ci-android-44-kasan-gce-386
2019/11/28 19:58 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 46869e3e .config console log report ci-android-44-kasan-gce-386
2019/11/26 22:25 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 1048481f .config console log report ci-android-44-kasan-gce-386
2019/11/25 18:09 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 371caf77 .config console log report ci-android-44-kasan-gce-386
2019/11/20 22:19 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8098ea0f .config console log report ci-android-44-kasan-gce-386
2019/11/20 17:38 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b f4b7ed07 .config console log report ci-android-44-kasan-gce-386
2019/11/19 12:07 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 5bc70212 .config console log report ci-android-44-kasan-gce-386
2019/11/18 15:04 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 1daed50a .config console log report ci-android-44-kasan-gce-386
2019/11/17 15:59 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b d5696d51 .config console log report ci-android-44-kasan-gce-386
2019/11/17 01:55 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b d5696d51 .config console log report ci-android-44-kasan-gce-386
2019/11/16 22:02 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b d5696d51 .config console log report ci-android-44-kasan-gce-386
2019/11/16 10:17 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b cdac920b .config console log report ci-android-44-kasan-gce-386
2019/11/14 07:22 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 048f2d49 .config console log report ci-android-44-kasan-gce-386
2019/11/13 00:06 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 048f2d49 .config console log report ci-android-44-kasan-gce-386
2019/11/12 03:06 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 048f2d49 .config console log report ci-android-44-kasan-gce-386
2019/11/11 22:40 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 048f2d49 .config console log report ci-android-44-kasan-gce-386
2019/11/11 21:06 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 048f2d49 .config console log report ci-android-44-kasan-gce-386
2019/11/10 14:21 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b dc438b91 .config console log report ci-android-44-kasan-gce-386
2019/10/31 15:15 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b a41ca8fa .config console log report ci-android-44-kasan-gce-386
2019/10/31 10:35 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b a41ca8fa .config console log report ci-android-44-kasan-gce-386
2019/10/29 13:17 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 5ea87a66 .config console log report ci-android-44-kasan-gce-386
2019/10/28 12:21 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 25bb509e .config console log report ci-android-44-kasan-gce-386
2019/10/27 13:40 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 25bb509e .config console log report ci-android-44-kasan-gce-386
2019/10/21 20:51 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b b24d2b8a .config console log report ci-android-44-kasan-gce-386
2019/10/21 15:49 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b b24d2b8a .config console log report ci-android-44-kasan-gce-386
2019/10/21 06:57 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8c88c9c1 .config console log report ci-android-44-kasan-gce-386
2019/10/17 16:44 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 8c88c9c1 .config console log report ci-android-44-kasan-gce-386
2019/10/15 15:01 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b b5268b89 .config console log report ci-android-44-kasan-gce-386
2019/10/14 02:04 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 2f661ec4 .config console log report ci-android-44-kasan-gce-386
2019/10/13 20:47 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b 2f661ec4 .config console log report ci-android-44-kasan-gce-386
2019/10/10 08:19 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b c4b9981b .config console log report ci-android-44-kasan-gce-386
2019/10/10 07:56 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b c4b9981b .config console log report ci-android-44-kasan-gce-386
2019/10/09 08:44 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b b1ebbfef .config console log report ci-android-44-kasan-gce-386
2019/10/06 09:02 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b f3f7d9c8 .config console log report ci-android-44-kasan-gce-386
2019/10/05 17:12 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b f3f7d9c8 .config console log report ci-android-44-kasan-gce-386
2019/10/03 17:57 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b fc17ba49 .config console log report ci-android-44-kasan-gce-386
2019/09/28 07:19 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b d8074e0b .config console log report ci-android-44-kasan-gce-386
2019/09/21 19:53 https://android.googlesource.com/kernel/common android-4.4 62872f952d6b d96e88f3 .config console log report ci-android-44-kasan-gce-386
2018/04/23 08:16 https://android.googlesource.com/kernel/common android-4.4 38f41ec1cb31 d23fcf6c .config console log report ci-android-44-kasan-gce-386
* Struck through repros no longer work on HEAD.