bisecting fixing commit since fc3abb53250a90ba2150eebd182137c136f4d25a
building syzkaller on abf9ba4fc75d9b29af15625d44dcfc1360fad3b7
testing commit fc3abb53250a90ba2150eebd182137c136f4d25a with gcc (GCC) 8.1.0
kernel signature: dfcab66d04c760212847cd7829140c9a2e69b4f0fb48ee520ff4be31f381ca6f
run #0: crashed: BUG: workqueue lockup
run #1: crashed: INFO: rcu detected stall in do_idle
run #2: crashed: BUG: workqueue lockup
run #3: crashed: INFO: rcu detected stall in do_idle
run #4: crashed: INFO: rcu detected stall in smp_call_function
run #5: crashed: BUG: workqueue lockup
run #6: crashed: INFO: rcu detected stall in corrupted
run #7: crashed: INFO: rcu detected stall in mutex_spin_on_owner
run #8: crashed: BUG: workqueue lockup
run #9: crashed: no output from test machine
testing current HEAD 71c061d2443814de15e177489d5cc00a4a253ef3
testing commit 71c061d2443814de15e177489d5cc00a4a253ef3 with gcc (GCC) 8.1.0
kernel signature: 189db90865f1f67b1ddb6affa454e615cd972fb0f3ed8dbf0d5fcd8a4105869d
run #0: boot failed: create image operation failed: &{Code:ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS Location: Message:The zone 'projects/syzkaller/zones/us-central1-c' does not have enough resources available to fulfill the request. '(resource type:compute)'. ForceSendFields:[] NullFields:[]}.
run #1: crashed: BUG: workqueue lockup
run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #3: crashed: BUG: workqueue lockup
run #4: crashed: BUG: workqueue lockup
run #5: crashed: BUG: workqueue lockup
run #6: crashed: BUG: workqueue lockup
run #7: crashed: BUG: workqueue lockup
run #8: crashed: INFO: rcu detected stall in do_idle
run #9: crashed: INFO: rcu detected stall in do_idle
revisions tested: 2, total time: 26m46.855714567s (build: 9m25.175142255s, test: 16m43.929393112s)
the crash still happens on HEAD
commit msg: Merge tag 'for-5.11-rc2-tag' of git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux
crash: INFO: rcu detected stall in do_idle
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 0-...!: (3 ticks this GP) idle=aae/0/0x1 softirq=9641/9641 fqs=0
(t=11022 jiffies g=4025 q=567)
rcu: rcu_preempt kthread starved for 11022 jiffies! g4025 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt state:I stack:14648 pid: 12 ppid: 2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:4313 [inline]
__schedule+0x420/0x900 kernel/sched/core.c:5064
schedule+0x38/0xe0 kernel/sched/core.c:5143
schedule_timeout+0x1be/0x2e0 kernel/time/timer.c:1878
rcu_gp_fqs_loop kernel/rcu/tree.c:1940 [inline]
rcu_gp_kthread+0x758/0xcc0 kernel/rcu/tree.c:2113
kthread+0x145/0x170 kernel/kthread.c:292
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:296
NMI backtrace for cpu 0
CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.11.0-rc2-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
__dump_stack lib/dump_stack.c:79 [inline]
dump_stack+0xa3/0xc8 lib/dump_stack.c:120
nmi_cpu_backtrace.cold.8+0x53/0x6d lib/nmi_backtrace.c:105
nmi_trigger_cpumask_backtrace+0xd5/0xf0 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
rcu_dump_cpu_stacks+0xa2/0xce kernel/rcu/tree_stall.h:337
print_cpu_stall kernel/rcu/tree_stall.h:569 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:643 [inline]
rcu_pending kernel/rcu/tree.c:3751 [inline]
rcu_sched_clock_irq.cold.97+0x61/0x5eb kernel/rcu/tree.c:2580
update_process_times+0x8e/0xc0 kernel/time/timer.c:1782
tick_sched_handle.isra.21+0x1a/0x50 kernel/time/tick-sched.c:226
tick_sched_timer+0x6a/0x80 kernel/time/tick-sched.c:1369
__run_hrtimer kernel/time/hrtimer.c:1519 [inline]
__hrtimer_run_queues+0x1e3/0x4f0 kernel/time/hrtimer.c:1583
hrtimer_interrupt+0xf9/0x210 kernel/time/hrtimer.c:1645
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
__sysvec_apic_timer_interrupt+0x8e/0x290 arch/x86/kernel/apic/apic.c:1102
asm_call_irq_on_stack+0xf/0x20
__run_sysvec_on_irqstack arch/x86/include/asm/irq_stack.h:37 [inline]
run_sysvec_on_irqstack_cond arch/x86/include/asm/irq_stack.h:89 [inline]
sysvec_apic_timer_interrupt+0xcc/0xf0 arch/x86/kernel/apic/apic.c:1096
asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:628
RIP: 0010:native_safe_halt+0xe/0x10 arch/x86/include/asm/irqflags.h:61
Code: 5b c3 65 48 8b 04 25 c0 7e 01 00 f0 80 48 02 20 48 8b 00 a8 08 75 c3 e9 7c ff ff ff e9 07 00 00 00 0f 00 2d 4c 37 4f 00 fb f4 90 e9 07 00 00 00 0f 00 2d 3c 37 4f 00 f4 c3 cc cc e8 db 07 ff
RSP: 0018:ffffffff84403e38 EFLAGS: 00000286
RAX: 000000000005b0e1 RBX: ffff888103c68000 RCX: 00000000ffffffff
RDX: 0000000000000000 RSI: ffffffff83f40fb3 RDI: ffffffff83f7e616
RBP: ffffffff8472cdc0 R08: 0000000000000001 R09: 0000000000000001
R10: ffff888237c2c684 R11: ffff888237c2c664 R12: 0000000000000001
R13: ffff888101324464 R14: 0000000000000001 R15: 0000000000000000
arch_safe_halt arch/x86/include/asm/paravirt.h:150 [inline]
acpi_safe_halt drivers/acpi/processor_idle.c:110 [inline]
acpi_idle_do_entry+0x50/0x90 drivers/acpi/processor_idle.c:516
acpi_idle_enter+0xa0/0xf0 drivers/acpi/processor_idle.c:647
cpuidle_enter_state+0x94/0x520 drivers/cpuidle/cpuidle.c:237
cpuidle_enter+0x24/0x40 drivers/cpuidle/cpuidle.c:351
call_cpuidle kernel/sched/idle.c:158 [inline]
cpuidle_idle_call kernel/sched/idle.c:239 [inline]
do_idle+0x2dc/0x350 kernel/sched/idle.c:299
cpu_startup_entry+0x14/0x20 kernel/sched/idle.c:396
start_kernel+0x4f2/0x511 init/main.c:1061
secondary_startup_64_no_verify+0xb0/0xbb