ci starts bisection 2023-03-30 12:35:44.326746981 +0000 UTC m=+87084.773094956 bisecting fixing commit since c7d102232649226a69dddd58a4942cf13cff4f7c building syzkaller on 6c236867ce33c0c16b102e02a08226d7eb9b2046 ensuring issue is reproducible on original commit c7d102232649226a69dddd58a4942cf13cff4f7c testing commit c7d102232649226a69dddd58a4942cf13cff4f7c gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 354d895afd4f0dfa461eda34597bde4daf164e94df96dae1ff3c525bb5297cd7 all runs: crashed: INFO: task hung in synchronize_rcu testing current HEAD 6f5d82806b50fa5f658796ef1c394577ba7b4a35 testing commit 6f5d82806b50fa5f658796ef1c394577ba7b4a35 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 099f1957167d5dbded356969b3b48f76355718041982a2b3a16da693f954e70b run #0: basic kernel testing failed: BUG: program execution failed: executor NUM: exit status NUM run #1: crashed: INFO: task hung in synchronize_rcu run #2: crashed: INFO: task hung in synchronize_rcu run #3: crashed: INFO: task hung in synchronize_rcu run #4: crashed: INFO: task hung in synchronize_rcu run #5: crashed: INFO: task hung in synchronize_rcu run #6: crashed: INFO: task hung in synchronize_rcu run #7: crashed: INFO: task hung in synchronize_rcu run #8: crashed: INFO: task hung in synchronize_rcu run #9: crashed: INFO: task hung in synchronize_rcu revisions tested: 2, total time: 33m0.475591594s (build: 15m48.881530075s, test: 15m48.152180021s) the crash still happens on HEAD commit msg: Merge branch 'fix-header-length-on-skb-merging' crash: INFO: task hung in synchronize_rcu INFO: task dhcpcd:11510 blocked for more than 143 seconds. Not tainted 6.3.0-rc3-syzkaller #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:dhcpcd state:D stack:29136 pid:11510 ppid:4640 flags:0x00000000 Call Trace: context_switch kernel/sched/core.c:5304 [inline] __schedule+0xa67/0x2e80 kernel/sched/core.c:6622 schedule+0xde/0x1a0 kernel/sched/core.c:6698 synchronize_rcu_expedited+0x5d4/0x770 kernel/rcu/tree_exp.h:1004 __unregister_prot_hook+0x363/0x480 net/packet/af_packet.c:382 packet_do_bind+0x635/0xb00 net/packet/af_packet.c:3226 __sys_bind+0x16f/0x1d0 net/socket.c:1801 __do_sys_bind net/socket.c:1812 [inline] __se_sys_bind net/socket.c:1810 [inline] __x64_sys_bind+0x6e/0xb0 net/socket.c:1810 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x39/0x80 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x63/0xcd RIP: 0033:0x7fe275d5dce7 RSP: 002b:00007ffc1dd42488 EFLAGS: 00000217 ORIG_RAX: 0000000000000031 RAX: ffffffffffffffda RBX: 000055fa90e1cb60 RCX: 00007fe275d5dce7 RDX: 0000000000000014 RSI: 00007ffc1dd42498 RDI: 0000000000000005 RBP: 0000000000000000 R08: 000055fa9218e590 R09: 00007fe275e1ea60 R10: 0000000000020000 R11: 0000000000000217 R12: 000055fa9218a3e0 R13: 000055fa9218eef8 R14: 00007ffc1dd62d6c R15: 00007ffc1dd62d94 Showing all locks held in the system: 1 lock held by rcu_tasks_kthre/12: #0: ffffffff8b183630 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x31/0xd80 kernel/rcu/tasks.h:510 1 lock held by rcu_tasks_trace/13: #0: ffffffff8b183330 (rcu_tasks_trace.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x31/0xd80 kernel/rcu/tasks.h:510 1 lock held by khungtaskd/28: #0: ffffffff8b184180 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x55/0x340 kernel/locking/lockdep.c:6495 5 locks held by kworker/1:3/4619: 2 locks held by getty/4738: #0: ffff8880259fb098 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x23/0x80 drivers/tty/tty_ldisc.c:244 #1: ffffc900015a02f0 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xb73/0x1040 drivers/tty/n_tty.c:2177 2 locks held by dhcpcd/11510: #0: ffff88807f19c130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88807f19c130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 #1: ffffffff8b18f478 (rcu_state.exp_mutex){+.+.}-{3:3}, at: exp_funnel_lock kernel/rcu/tree_exp.h:293 [inline] #1: ffffffff8b18f478 (rcu_state.exp_mutex){+.+.}-{3:3}, at: synchronize_rcu_expedited+0x64a/0x770 kernel/rcu/tree_exp.h:989 2 locks held by dhcpcd/12265: #0: ffff88805bb00130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88805bb00130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 #1: ffffffff8b18f478 (rcu_state.exp_mutex){+.+.}-{3:3}, at: exp_funnel_lock kernel/rcu/tree_exp.h:325 [inline] #1: ffffffff8b18f478 (rcu_state.exp_mutex){+.+.}-{3:3}, at: synchronize_rcu_expedited+0x3e8/0x770 kernel/rcu/tree_exp.h:989 1 lock held by dhcpcd/12338: #0: ffff88805ce30130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88805ce30130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by dhcpcd/12343: #0: ffff88801ddbc130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88801ddbc130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by dhcpcd/12404: #0: ffff88802843c130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88802843c130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by dhcpcd/15302: #0: ffff888021124130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff888021124130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by dhcpcd/15347: #0: ffff88802897a130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88802897a130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by dhcpcd/15354: #0: ffff88805053a130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88805053a130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by dhcpcd/15359: #0: ffff88804fc7a130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff88804fc7a130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by dhcpcd/15378: #0: ffff888026d10130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: lock_sock include/net/sock.h:1697 [inline] #0: ffff888026d10130 (sk_lock-AF_PACKET){+.+.}-{0:0}, at: packet_do_bind+0x27/0xb00 net/packet/af_packet.c:3193 1 lock held by syz-executor.0/15857: 2 locks held by syz-executor.0/15858: ============================================= NMI backtrace for cpu 0 CPU: 0 PID: 28 Comm: khungtaskd Not tainted 6.3.0-rc3-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/02/2023 Call Trace: __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0x64/0xb0 lib/dump_stack.c:106 nmi_cpu_backtrace+0x175/0x200 lib/nmi_backtrace.c:113 nmi_trigger_cpumask_backtrace+0x1bc/0x200 lib/nmi_backtrace.c:62 trigger_all_cpu_backtrace include/linux/nmi.h:148 [inline] check_hung_uninterruptible_tasks kernel/hung_task.c:222 [inline] watchdog+0x9f9/0xcf0 kernel/hung_task.c:379 kthread+0x298/0x340 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308 Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 46 Comm: kworker/u4:3 Not tainted 6.3.0-rc3-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/02/2023 Workqueue: events_unbound toggle_allocation_gate RIP: 0010:smp_call_function_many_cond+0x2/0xc50 kernel/smp.c:886 Code: 44 89 e0 5d 41 5c c3 e8 ec 45 97 ff 44 89 e0 5d 41 5c c3 e8 c0 93 4d 00 eb b6 41 bc f0 ff ff ff eb c9 66 0f 1f 44 00 00 41 57 <41> 56 41 55 49 89 d5 41 54 55 53 48 89 fb 48 83 ec 70 89 4c 24 3c RSP: 0018:ffffc90000b77ad8 EFLAGS: 00000246 RAX: dffffc0000000000 RBX: 0000000000000000 RCX: 0000000000000003 RDX: 0000000000000000 RSI: ffffffff81293fe0 RDI: ffffffff8cf32750 RBP: ffffffff8cf32750 R08: 0000000000000000 R09: ffffffff8cf32fc3 R10: fffffbfff19e65f8 R11: 0000000000000000 R12: ffffffff81293fe0 R13: 0000000000000000 R14: 0000000000000003 R15: ffffffff8e6c1450 FS: 0000000000000000(0000) GS:ffff8880b9d00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000000970004 CR3: 000000000af6c000 CR4: 00000000003506e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: on_each_cpu_cond_mask+0x43/0x70 kernel/smp.c:1155 on_each_cpu include/linux/smp.h:71 [inline] text_poke_sync arch/x86/kernel/alternative.c:1770 [inline] text_poke_bp_batch+0x423/0x770 arch/x86/kernel/alternative.c:2032 text_poke_flush arch/x86/kernel/alternative.c:2161 [inline] text_poke_flush arch/x86/kernel/alternative.c:2158 [inline] text_poke_finish+0x1a/0x30 arch/x86/kernel/alternative.c:2168 arch_jump_label_transform_apply+0x17/0x30 arch/x86/kernel/jump_label.c:146 static_key_enable_cpuslocked+0x163/0x220 kernel/jump_label.c:205 static_key_enable+0x15/0x20 kernel/jump_label.c:218 toggle_allocation_gate mm/kfence/core.c:799 [inline] toggle_allocation_gate+0xdb/0x1e0 mm/kfence/core.c:791 process_one_work+0x865/0x1400 kernel/workqueue.c:2390 worker_thread+0x59c/0xec0 kernel/workqueue.c:2537 kthread+0x298/0x340 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308