syzbot


INFO: task hung in vivid_stop_generating_vid_cap

Status: fixed on 2019/12/31 04:23
Reported-by: syzbot+0dd901f5638f18daa476@syzkaller.appspotmail.com
Fix commit: 467052f6ea5a media: vivid: Fix wrong locking that causes race conditions on streaming stop
First crash: 2051d, last: 1817d
Fix bisection: fixed by (bisect log) :
commit 467052f6ea5a51524992e43f02b543550495c391
Author: Alexander Popov <alex.popov@linux.com>
Date: Sun Nov 3 22:17:19 2019 +0000

  media: vivid: Fix wrong locking that causes race conditions on streaming stop

  
Similar bugs (2)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: task hung in vivid_stop_generating_vid_cap C done done 81 2212d 2215d 13/28 fixed on 2019/11/11 17:14
linux-4.14 INFO: task hung in vivid_stop_generating_vid_cap C error 315 1728d 2051d 0/1 upstream: reported C repro on 2019/04/11 12:40

Sample crash report:
INFO: task syz-executor662:7532 blocked for more than 140 seconds.
      Not tainted 4.19.81 #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor662 D28216  7532   7528 0x80000002
Call Trace:
 context_switch kernel/sched/core.c:2826 [inline]
 __schedule+0x866/0x1dc0 kernel/sched/core.c:3515
 schedule+0x92/0x1c0 kernel/sched/core.c:3559
 schedule_timeout+0x8c8/0xfc0 kernel/time/timer.c:1782
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common kernel/sched/completion.c:115 [inline]
 wait_for_completion+0x29c/0x440 kernel/sched/completion.c:136
 kthread_stop+0x116/0x6c0 kernel/kthread.c:550
 vivid_stop_generating_vid_cap+0x1e0/0x6e2 drivers/media/platform/vivid/vivid-kthread-cap.c:922
 vid_cap_stop_streaming+0x8a/0xe0 drivers/media/platform/vivid/vivid-vid-cap.c:256
 __vb2_queue_cancel+0xb1/0x790 drivers/media/common/videobuf2/videobuf2-core.c:1682
 vb2_core_streamoff+0x60/0x150 drivers/media/common/videobuf2/videobuf2-core.c:1816
 __vb2_cleanup_fileio+0x78/0x170 drivers/media/common/videobuf2/videobuf2-core.c:2343
 vb2_core_queue_release+0x20/0x80 drivers/media/common/videobuf2/videobuf2-core.c:2070
 vb2_queue_release drivers/media/common/videobuf2/videobuf2-v4l2.c:671 [inline]
 _vb2_fop_release+0x1cf/0x2a0 drivers/media/common/videobuf2/videobuf2-v4l2.c:842
 vb2_fop_release+0x75/0xc0 drivers/media/common/videobuf2/videobuf2-v4l2.c:856
 vivid_fop_release+0x18e/0x430 drivers/media/platform/vivid/vivid-core.c:474
 v4l2_release+0xf9/0x1a0 drivers/media/v4l2-core/v4l2-dev.c:448
 __fput+0x2dd/0x8b0 fs/file_table.c:278
 ____fput+0x16/0x20 fs/file_table.c:309
 task_work_run+0x145/0x1c0 kernel/task_work.c:113
 exit_task_work include/linux/task_work.h:22 [inline]
 do_exit+0x994/0x2fa0 kernel/exit.c:876
 do_group_exit+0x135/0x370 kernel/exit.c:979
 __do_sys_exit_group kernel/exit.c:990 [inline]
 __se_sys_exit_group kernel/exit.c:988 [inline]
 __x64_sys_exit_group+0x44/0x50 kernel/exit.c:988
 do_syscall_64+0xfd/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x443c18
Code: 70 6c 65 61 73 65 20 63 68 61 6e 67 65 20 73 79 6e 74 61 78 2c 20 27 25 73 27 20 77 69 6c 6c 20 6e 6f 74 20 62 65 20 73 75 70 <70> 6f 72 74 65 64 20 69 6e 20 72 73 79 73 6c 6f 67 20 76 36 20 61
RSP: 002b:00007ffcf6db9bd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 0000000000443c18
RDX: 0000000000000000 RSI: 000000000000003c RDI: 0000000000000000
RBP: 00000000004c35d0 R08: 00000000000000e7 R09: ffffffffffffffd0
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000001
R13: 00000000006d5180 R14: 0000000000000000 R15: 0000000000000000
INFO: task syz-executor662:7536 blocked for more than 140 seconds.
      Not tainted 4.19.81 #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor662 D28216  7536   7527 0x80000002
Call Trace:
 context_switch kernel/sched/core.c:2826 [inline]
 __schedule+0x866/0x1dc0 kernel/sched/core.c:3515
 schedule+0x92/0x1c0 kernel/sched/core.c:3559
 schedule_timeout+0x8c8/0xfc0 kernel/time/timer.c:1782
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common kernel/sched/completion.c:115 [inline]
 wait_for_completion+0x29c/0x440 kernel/sched/completion.c:136
 kthread_stop+0x116/0x6c0 kernel/kthread.c:550
 vivid_stop_generating_vid_cap+0x1e0/0x6e2 drivers/media/platform/vivid/vivid-kthread-cap.c:922
 vid_cap_stop_streaming+0x8a/0xe0 drivers/media/platform/vivid/vivid-vid-cap.c:256
 __vb2_queue_cancel+0xb1/0x790 drivers/media/common/videobuf2/videobuf2-core.c:1682
 vb2_core_streamoff+0x60/0x150 drivers/media/common/videobuf2/videobuf2-core.c:1816
 __vb2_cleanup_fileio+0x78/0x170 drivers/media/common/videobuf2/videobuf2-core.c:2343
 vb2_core_queue_release+0x20/0x80 drivers/media/common/videobuf2/videobuf2-core.c:2070
 vb2_queue_release drivers/media/common/videobuf2/videobuf2-v4l2.c:671 [inline]
 _vb2_fop_release+0x1cf/0x2a0 drivers/media/common/videobuf2/videobuf2-v4l2.c:842
 vb2_fop_release+0x75/0xc0 drivers/media/common/videobuf2/videobuf2-v4l2.c:856
 vivid_fop_release+0x18e/0x430 drivers/media/platform/vivid/vivid-core.c:474
 v4l2_release+0xf9/0x1a0 drivers/media/v4l2-core/v4l2-dev.c:448
 __fput+0x2dd/0x8b0 fs/file_table.c:278
 ____fput+0x16/0x20 fs/file_table.c:309
 task_work_run+0x145/0x1c0 kernel/task_work.c:113
 exit_task_work include/linux/task_work.h:22 [inline]
 do_exit+0x994/0x2fa0 kernel/exit.c:876
 do_group_exit+0x135/0x370 kernel/exit.c:979
 __do_sys_exit_group kernel/exit.c:990 [inline]
 __se_sys_exit_group kernel/exit.c:988 [inline]
 __x64_sys_exit_group+0x44/0x50 kernel/exit.c:988
 do_syscall_64+0xfd/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x443c18
Code: 70 6c 65 61 73 65 20 63 68 61 6e 67 65 20 73 79 6e 74 61 78 2c 20 27 25 73 27 20 77 69 6c 6c 20 6e 6f 74 20 62 65 20 73 75 70 <70> 6f 72 74 65 64 20 69 6e 20 72 73 79 73 6c 6f 67 20 76 36 20 61
RSP: 002b:00007ffcf6db9bd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 0000000000443c18
RDX: 0000000000000000 RSI: 000000000000003c RDI: 0000000000000000
RBP: 00000000004c35d0 R08: 00000000000000e7 R09: ffffffffffffffd0
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000001
R13: 00000000006d5180 R14: 0000000000000000 R15: 0000000000000000
INFO: task syz-executor662:7782 blocked for more than 140 seconds.
      Not tainted 4.19.81 #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor662 D28216  7782   7530 0x80000002
Call Trace:
 context_switch kernel/sched/core.c:2826 [inline]
 __schedule+0x866/0x1dc0 kernel/sched/core.c:3515
 schedule+0x92/0x1c0 kernel/sched/core.c:3559
 schedule_timeout+0x8c8/0xfc0 kernel/time/timer.c:1782
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common kernel/sched/completion.c:115 [inline]
 wait_for_completion+0x29c/0x440 kernel/sched/completion.c:136
 kthread_stop+0x116/0x6c0 kernel/kthread.c:550
 vivid_stop_generating_vid_cap+0x1e0/0x6e2 drivers/media/platform/vivid/vivid-kthread-cap.c:922
 vid_cap_stop_streaming+0x8a/0xe0 drivers/media/platform/vivid/vivid-vid-cap.c:256
 __vb2_queue_cancel+0xb1/0x790 drivers/media/common/videobuf2/videobuf2-core.c:1682
 vb2_core_streamoff+0x60/0x150 drivers/media/common/videobuf2/videobuf2-core.c:1816
 __vb2_cleanup_fileio+0x78/0x170 drivers/media/common/videobuf2/videobuf2-core.c:2343
 vb2_core_queue_release+0x20/0x80 drivers/media/common/videobuf2/videobuf2-core.c:2070
 vb2_queue_release drivers/media/common/videobuf2/videobuf2-v4l2.c:671 [inline]
 _vb2_fop_release+0x1cf/0x2a0 drivers/media/common/videobuf2/videobuf2-v4l2.c:842
 vb2_fop_release+0x75/0xc0 drivers/media/common/videobuf2/videobuf2-v4l2.c:856
 vivid_fop_release+0x18e/0x430 drivers/media/platform/vivid/vivid-core.c:474
 v4l2_release+0xf9/0x1a0 drivers/media/v4l2-core/v4l2-dev.c:448
 __fput+0x2dd/0x8b0 fs/file_table.c:278
 ____fput+0x16/0x20 fs/file_table.c:309
 task_work_run+0x145/0x1c0 kernel/task_work.c:113
 exit_task_work include/linux/task_work.h:22 [inline]
 do_exit+0x994/0x2fa0 kernel/exit.c:876
 do_group_exit+0x135/0x370 kernel/exit.c:979
 __do_sys_exit_group kernel/exit.c:990 [inline]
 __se_sys_exit_group kernel/exit.c:988 [inline]
 __x64_sys_exit_group+0x44/0x50 kernel/exit.c:988
 do_syscall_64+0xfd/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x443c18
Code: Bad RIP value.
RSP: 002b:00007ffcf6db9bd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 0000000000443c18
RDX: 0000000000000000 RSI: 000000000000003c RDI: 0000000000000000
RBP: 00000000004c35d0 R08: 00000000000000e7 R09: ffffffffffffffd0
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000001
R13: 00000000006d5180 R14: 0000000000000000 R15: 0000000000000000
INFO: task syz-executor662:7800 blocked for more than 140 seconds.
      Not tainted 4.19.81 #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor662 D28216  7800   7526 0x80000002
Call Trace:
 context_switch kernel/sched/core.c:2826 [inline]
 __schedule+0x866/0x1dc0 kernel/sched/core.c:3515
 schedule+0x92/0x1c0 kernel/sched/core.c:3559
 schedule_timeout+0x8c8/0xfc0 kernel/time/timer.c:1782
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common kernel/sched/completion.c:115 [inline]
 wait_for_completion+0x29c/0x440 kernel/sched/completion.c:136
 kthread_stop+0x116/0x6c0 kernel/kthread.c:550
 vivid_stop_generating_vid_cap+0x1e0/0x6e2 drivers/media/platform/vivid/vivid-kthread-cap.c:922
 vid_cap_stop_streaming+0x8a/0xe0 drivers/media/platform/vivid/vivid-vid-cap.c:256
 __vb2_queue_cancel+0xb1/0x790 drivers/media/common/videobuf2/videobuf2-core.c:1682
 vb2_core_streamoff+0x60/0x150 drivers/media/common/videobuf2/videobuf2-core.c:1816
 __vb2_cleanup_fileio+0x78/0x170 drivers/media/common/videobuf2/videobuf2-core.c:2343
 vb2_core_queue_release+0x20/0x80 drivers/media/common/videobuf2/videobuf2-core.c:2070
 vb2_queue_release drivers/media/common/videobuf2/videobuf2-v4l2.c:671 [inline]
 _vb2_fop_release+0x1cf/0x2a0 drivers/media/common/videobuf2/videobuf2-v4l2.c:842
 vb2_fop_release+0x75/0xc0 drivers/media/common/videobuf2/videobuf2-v4l2.c:856
 vivid_fop_release+0x18e/0x430 drivers/media/platform/vivid/vivid-core.c:474
 v4l2_release+0xf9/0x1a0 drivers/media/v4l2-core/v4l2-dev.c:448
 __fput+0x2dd/0x8b0 fs/file_table.c:278
 ____fput+0x16/0x20 fs/file_table.c:309
 task_work_run+0x145/0x1c0 kernel/task_work.c:113
 exit_task_work include/linux/task_work.h:22 [inline]
 do_exit+0x994/0x2fa0 kernel/exit.c:876
 do_group_exit+0x135/0x370 kernel/exit.c:979
 __do_sys_exit_group kernel/exit.c:990 [inline]
 __se_sys_exit_group kernel/exit.c:988 [inline]
 __x64_sys_exit_group+0x44/0x50 kernel/exit.c:988
 do_syscall_64+0xfd/0x620 arch/x86/entry/common.c:293
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x443c18
Code: Bad RIP value.
RSP: 002b:00007ffcf6db9bd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 0000000000443c18
RDX: 0000000000000000 RSI: 000000000000003c RDI: 0000000000000000
RBP: 00000000004c35d0 R08: 00000000000000e7 R09: ffffffffffffffd0
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000001
R13: 00000000006d5180 R14: 0000000000000000 R15: 0000000000000000

Showing all locks held in the system:
1 lock held by khungtaskd/1037:
 #0: 000000009ec930af (rcu_read_lock){....}, at: debug_show_all_locks+0x5f/0x27e kernel/locking/lockdep.c:4438
2 locks held by getty/7497:
 #0: 00000000f63bdef6 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:362
 #1: 00000000340d18a1 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7498:
 #0: 00000000d3829a3f (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:362
 #1: 00000000270ba620 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7499:
 #0: 000000002d3791e3 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:362
 #1: 000000000c78034f (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7500:
 #0: 0000000098af2b01 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:362
 #1: 00000000d4b8beb8 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7501:
 #0: 00000000b4342c74 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:362
 #1: 000000004a16af0d (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7502:
 #0: 00000000987d1a96 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:362
 #1: 00000000b94411b4 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154
2 locks held by getty/7503:
 #0: 00000000fc6e0c8b (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:362
 #1: 00000000bf8c0f66 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1b30 drivers/tty/n_tty.c:2154

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1037 Comm: khungtaskd Not tainted 4.19.81 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x172/0x1f0 lib/dump_stack.c:113
 nmi_cpu_backtrace.cold+0x63/0xa4 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x1b0/0x1f8 lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:203 [inline]
 watchdog+0x9df/0xee0 kernel/hung_task.c:287
 kthread+0x354/0x420 kernel/kthread.c:246
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1 skipped: idling at native_safe_halt+0xe/0x10 arch/x86/include/asm/irqflags.h:60

Crashes (291):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/11/05 18:48 linux-4.19.y ef244c308885 af5c522d .config console log report syz C ci2-linux-4-19
2019/10/19 00:01 linux-4.19.y c3038e718a19 8c88c9c1 .config console log report syz C ci2-linux-4-19
2019/06/24 05:49 linux-4.19.y 78778071092e 472f0082 .config console log report syz C ci2-linux-4-19
2019/06/17 04:55 linux-4.19.y 7aa823a959e1 442206d7 .config console log report syz C ci2-linux-4-19
2019/06/10 19:00 linux-4.19.y bb7b450e61a1 0159583c .config console log report syz C ci2-linux-4-19
2019/05/08 01:45 linux-4.19.y 1656b1457209 a7383bfa .config console log report syz C ci2-linux-4-19
2019/11/30 21:12 linux-4.19.y 14260788bbb9 a76bf83f .config console log report ci2-linux-4-19
2019/11/27 20:02 linux-4.19.y 14260788bbb9 0d63f89c .config console log report ci2-linux-4-19
2019/11/27 15:21 linux-4.19.y 14260788bbb9 1048481f .config console log report ci2-linux-4-19
2019/11/27 11:06 linux-4.19.y 14260788bbb9 1048481f .config console log report ci2-linux-4-19
2019/11/24 21:50 linux-4.19.y 14260788bbb9 598ca6c8 .config console log report ci2-linux-4-19
2019/11/24 19:30 linux-4.19.y 14260788bbb9 598ca6c8 .config console log report ci2-linux-4-19
2019/11/24 15:52 linux-4.19.y 14260788bbb9 598ca6c8 .config console log report ci2-linux-4-19
2019/11/23 23:16 linux-4.19.y c63ee2939dc1 598ca6c8 .config console log report ci2-linux-4-19
2019/11/23 09:39 linux-4.19.y c63ee2939dc1 598ca6c8 .config console log report ci2-linux-4-19
2019/11/23 04:31 linux-4.19.y c63ee2939dc1 598ca6c8 .config console log report ci2-linux-4-19
2019/11/22 16:20 linux-4.19.y c63ee2939dc1 598ca6c8 .config console log report ci2-linux-4-19
2019/11/22 10:39 linux-4.19.y c63ee2939dc1 598ca6c8 .config console log report ci2-linux-4-19
2019/11/20 19:01 linux-4.19.y c555efaf1402 432c7650 .config console log report ci2-linux-4-19
2019/11/19 19:30 linux-4.19.y c555efaf1402 432c7650 .config console log report ci2-linux-4-19
2019/11/17 22:06 linux-4.19.y c555efaf1402 d5696d51 .config console log report ci2-linux-4-19
2019/11/16 07:33 linux-4.19.y c555efaf1402 cdac920b .config console log report ci2-linux-4-19
2019/11/15 00:38 linux-4.19.y c555efaf1402 048f2d49 .config console log report ci2-linux-4-19
2019/11/13 04:43 linux-4.19.y 7d8dbefc22ff 048f2d49 .config console log report ci2-linux-4-19
2019/11/11 15:04 linux-4.19.y 7d8dbefc22ff dc438b91 .config console log report ci2-linux-4-19
2019/11/10 11:41 linux-4.19.y 5ee93551c703 dc438b91 .config console log report ci2-linux-4-19
2019/11/10 02:09 linux-4.19.y 5ee93551c703 dc438b91 .config console log report ci2-linux-4-19
2019/11/09 06:11 linux-4.19.y 5ee93551c703 1e35461e .config console log report ci2-linux-4-19
2019/11/07 09:59 linux-4.19.y 5ee93551c703 d797d201 .config console log report ci2-linux-4-19
2019/11/06 13:01 linux-4.19.y 5ee93551c703 bc2c6e45 .config console log report ci2-linux-4-19
2019/11/05 12:33 linux-4.19.y ef244c308885 0f3ec414 .config console log report ci2-linux-4-19
2019/10/29 20:49 linux-4.19.y ef244c308885 5ea87a66 .config console log report ci2-linux-4-19
2019/10/29 09:29 linux-4.19.y ef244c308885 5ea87a66 .config console log report ci2-linux-4-19
2019/10/27 10:59 linux-4.19.y c3038e718a19 25bb509e .config console log report ci2-linux-4-19
2019/10/26 20:19 linux-4.19.y c3038e718a19 25bb509e .config console log report ci2-linux-4-19
2019/10/25 17:14 linux-4.19.y c3038e718a19 04ca72cd .config console log report ci2-linux-4-19
2019/10/24 03:36 linux-4.19.y c3038e718a19 b602d64b .config console log report ci2-linux-4-19
2019/10/24 01:10 linux-4.19.y c3038e718a19 b602d64b .config console log report ci2-linux-4-19
2019/10/23 10:58 linux-4.19.y c3038e718a19 d0686497 .config console log report ci2-linux-4-19
2019/10/22 14:36 linux-4.19.y c3038e718a19 4ee855e7 .config console log report ci2-linux-4-19
2019/10/22 00:41 linux-4.19.y c3038e718a19 c59a7cd8 .config console log report ci2-linux-4-19
2019/10/21 19:03 linux-4.19.y c3038e718a19 b24d2b8a .config console log report ci2-linux-4-19
2019/10/19 20:53 linux-4.19.y c3038e718a19 8c88c9c1 .config console log report ci2-linux-4-19
2019/10/19 07:58 linux-4.19.y c3038e718a19 8c88c9c1 .config console log report ci2-linux-4-19
2019/10/17 10:30 linux-4.19.y dafd634415a7 8c88c9c1 .config console log report ci2-linux-4-19
2019/10/15 18:19 linux-4.19.y dafd634415a7 b5268b89 .config console log report ci2-linux-4-19
2019/10/15 03:12 linux-4.19.y dafd634415a7 05ad7292 .config console log report ci2-linux-4-19
2019/04/11 01:37 linux-4.19.y 4d552acf3370 65b612b7 .config console log report ci2-linux-4-19
* Struck through repros no longer work on HEAD.