syzbot


INFO: rcu detected stall in clone

Status: auto-closed as invalid on 2021/02/24 09:47
Subsystems: bpf
[Documentation on labels]
First crash: 1249d, last: 1240d
Similar bugs (2)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in clone (2) kernel 14 804d 1111d 0/26 closed as invalid on 2022/02/08 10:00
upstream INFO: rcu detected stall in clone (3) kernel 7 625d 724d 0/26 auto-obsoleted due to no activity on 2022/10/31 19:01

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...!: (2 ticks this GP) idle=c92/1/0x4000000000000000 softirq=64737/64737 fqs=0 
	(detected by 1, t=18809 jiffies, g=96381, q=95)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 4898 Comm: systemd-udevd Not tainted 5.10.0-rc4-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:get_l4proto+0x11a/0x530 net/netfilter/nf_conntrack_core.c:394
Code: 08 00 00 00 00 48 8b 84 24 a0 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 bd 03 00 00 48 81 c4 a8 00 00 00 44 89 f0 5b 5d 41 5c <41> 5d 41 5e 41 5f c3 e8 fa 2c 3e fa 48 8d 7d 70 48 89 f8 48 c1 e8
RSP: 0018:ffffc900000073f0 EFLAGS: 00000286
RAX: 0000000000000014 RBX: 0000000000000000 RCX: ffffffff87320488
RDX: ffff888011918000 RSI: ffffffff87320299 RDI: 0000000000000004
RBP: ffff8880281693c0 R08: 0000000000000001 R09: ffffffff8ebb171f
R10: 0000000000000014 R11: 0000000000000000 R12: ffff8880281693c0
R13: 0000000000000000 R14: 0000000000000014 R15: ffff88806995a0c4
FS:  00007f9c942c38c0(0000) GS:ffff8880b9e00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000045de8f CR3: 0000000013423000 CR4: 00000000001526f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 nf_conntrack_in+0x25e/0x1330 net/netfilter/nf_conntrack_core.c:1809
 ipv4_conntrack_local+0x11c/0x220 net/netfilter/nf_conntrack_proto.c:200
 nf_hook_entry_hookfn include/linux/netfilter.h:136 [inline]
 nf_hook_slow+0xc5/0x1e0 net/netfilter/core.c:589
 nf_hook+0x2cf/0x5a0 include/linux/netfilter.h:256
 __ip_local_out+0x26e/0x530 net/ipv4/ip_output.c:115
 ip_local_out net/ipv4/ip_output.c:124 [inline]
 __ip_queue_xmit+0x85d/0x1a00 net/ipv4/ip_output.c:532
 sctp_packet_transmit+0x22ff/0x3620 net/sctp/output.c:629
 sctp_outq_flush_transports net/sctp/outqueue.c:1147 [inline]
 sctp_outq_flush+0x2aa/0x2580 net/sctp/outqueue.c:1195
 sctp_cmd_interpreter net/sctp/sm_sideeffect.c:1801 [inline]
 sctp_side_effects net/sctp/sm_sideeffect.c:1185 [inline]
 sctp_do_sm+0x745/0x5120 net/sctp/sm_sideeffect.c:1156
 sctp_generate_heartbeat_event+0x2b5/0x490 net/sctp/sm_sideeffect.c:391
 call_timer_fn+0x1a5/0x6b0 kernel/time/timer.c:1410
 expire_timers kernel/time/timer.c:1455 [inline]
 __run_timers.part.0+0x67c/0xa50 kernel/time/timer.c:1747
 __run_timers kernel/time/timer.c:1728 [inline]
 run_timer_softirq+0xb3/0x1d0 kernel/time/timer.c:1760
 __do_softirq+0x2a0/0x9f6 kernel/softirq.c:298
 asm_call_irq_on_stack+0xf/0x20
 </IRQ>
 __run_on_irqstack arch/x86/include/asm/irq_stack.h:26 [inline]
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:77 [inline]
 do_softirq_own_stack+0xaa/0xd0 arch/x86/kernel/irq_64.c:77
 invoke_softirq kernel/softirq.c:393 [inline]
 __irq_exit_rcu kernel/softirq.c:423 [inline]
 irq_exit_rcu+0x132/0x200 kernel/softirq.c:435
 sysvec_apic_timer_interrupt+0x4d/0x100 arch/x86/kernel/apic/apic.c:1091
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:631
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/irqflags.h:85 [inline]
RIP: 0010:lock_acquire kernel/locking/lockdep.c:5438 [inline]
RIP: 0010:lock_acquire+0x2cd/0x8c0 kernel/locking/lockdep.c:5400
Code: 48 c7 c7 c0 5e 4b 89 48 83 c4 20 e8 dd 44 8f 07 b8 ff ff ff ff 65 0f c1 05 b0 b2 ab 7e 83 f8 01 0f 85 09 04 00 00 ff 34 24 9d <e9> 37 fe ff ff 65 ff 05 57 a1 ab 7e 48 8b 05 d0 a4 82 0b e8 6b 39
RSP: 0018:ffffc9000163f510 EFLAGS: 00000246
RAX: 0000000000000001 RBX: 1ffff920002c7ea4 RCX: 000000007bffdac4
RDX: 1ffff11002323121 RSI: 0000000000000000 RDI: 0000000000000000
RBP: 0000000000000000 R08: 0000000000000000 R09: ffffffff8ebb1667
R10: fffffbfff1d762cc R11: 0000000000000000 R12: 0000000000000002
R13: ffffffff8b337820 R14: 0000000000000000 R15: 0000000000000000
 rcu_lock_acquire include/linux/rcupdate.h:248 [inline]
 rcu_read_lock include/linux/rcupdate.h:641 [inline]
 is_bpf_text_address+0x36/0x160 kernel/bpf/core.c:708
 kernel_text_address kernel/extable.c:151 [inline]
 kernel_text_address+0xbd/0xf0 kernel/extable.c:120
 __kernel_text_address+0x9/0x30 kernel/extable.c:105
 unwind_get_return_address arch/x86/kernel/unwind_orc.c:318 [inline]
 unwind_get_return_address+0x51/0x90 arch/x86/kernel/unwind_orc.c:313
 arch_stack_walk+0x93/0xe0 arch/x86/kernel/stacktrace.c:26
 stack_trace_save+0x8c/0xc0 kernel/stacktrace.c:121
 kasan_save_stack+0x1b/0x40 mm/kasan/common.c:48
 kasan_set_track mm/kasan/common.c:56 [inline]
 __kasan_kmalloc.constprop.0+0xc2/0xd0 mm/kasan/common.c:461
 slab_post_alloc_hook mm/slab.h:526 [inline]
 slab_alloc_node mm/slub.c:2891 [inline]
 slab_alloc mm/slub.c:2899 [inline]
 kmem_cache_alloc+0x122/0x460 mm/slub.c:2904
 anon_vma_alloc mm/rmap.c:89 [inline]
 anon_vma_fork+0xed/0x630 mm/rmap.c:354
 dup_mmap kernel/fork.c:549 [inline]
 dup_mm+0x944/0x12a0 kernel/fork.c:1357
 copy_mm kernel/fork.c:1413 [inline]
 copy_process+0x2a05/0x6e80 kernel/fork.c:2095
 kernel_clone+0xe7/0xab0 kernel/fork.c:2456
 __do_sys_clone+0xc8/0x110 kernel/fork.c:2573
 do_syscall_64+0x2d/0x70 arch/x86/entry/common.c:46
 entry_SYSCALL_64_after_hwframe+0x44/0xa9
RIP: 0033:0x7f9c9311338b
Code: db 45 85 f6 0f 85 95 01 00 00 64 4c 8b 04 25 10 00 00 00 31 d2 4d 8d 90 d0 02 00 00 31 f6 bf 11 00 20 01 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 0f 87 de 00 00 00 85 c0 41 89 c5 0f 85 e5 00 00
RSP: 002b:00007ffd9ce3fe20 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
RAX: ffffffffffffffda RBX: 00007ffd9ce3fe20 RCX: 00007f9c9311338b
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
RBP: 00007ffd9ce3fe70 R08: 00007f9c942c38c0 R09: 0000000000000210
R10: 00007f9c942c3b90 R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000020 R14: 0000000000000000 R15: 0000000000000000
rcu: rcu_preempt kthread starved for 18809 jiffies! g96381 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
BUG: workqueue lockup - pool
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:28872 pid:   11 ppid:     2 flags:0x00004000
Call Trace:
 context_switch kernel/sched/core.c:3774 [inline]
 __schedule+0x893/0x2130 kernel/sched/core.c:4523
 cpus=0-1
 schedule+0xcf/0x270 kernel/sched/core.c:4601
 schedule_timeout+0x148/0x250 kernel/time/timer.c:1871
 flags=0x4 nice=0
 rcu_gp_fqs_loop kernel/rcu/tree.c:1925 [inline]
 rcu_gp_kthread+0xb4c/0x1c90 kernel/rcu/tree.c:2099
 stuck for 188s!
Showing busy workqueues and worker pools:
 kthread+0x3af/0x4a0 kernel/kthread.c:292
workqueue events: flags=0x0
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:296
  pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=12/256 refcnt=13
    pending: delayed_fput, nsim_dev_trap_report_work, nsim_dev_trap_report_work, ovs_dp_masks_rebalance, psi_avgs_work, psi_avgs_work, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=17/256 refcnt=18
    pending: console_callback, nsim_dev_trap_report_work, nsim_dev_trap_report_work, nsim_dev_trap_report_work, nsim_dev_trap_report_work, psi_avgs_work, psi_avgs_work, psi_avgs_work, psi_avgs_work, psi_avgs_work, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, ovs_dp_masks_rebalance, kvmclock_sync_fn, vmstat_shepherd
workqueue events_long: flags=0x0
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=4/256 refcnt=5
    pending: defense_work_handler, defense_work_handler, defense_work_handler, br_fdb_cleanup
workqueue events_unbound: flags=0x2
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/512 refcnt=4
    pending: flush_to_ldisc
workqueue events_power_efficient: flags=0x80
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_ratelimiter_gc_entries, gc_worker, do_cache_clean
workqueue mm_percpu_wq: flags=0x8
  pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: lru_add_drain_per_cpu
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=4
    pending: vmstat_update, lru_add_drain_per_cpu BAR(1665)
workqueue writeback: flags=0x4a
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=4
    pending: wb_workfn
workqueue usb_hub_wq: flags=0x4
  pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: hub_event
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    in-flight: 7:hub_event hub_event
workqueue dm_bufio_cache: flags=0x8
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: work_fn
workqueue krxrpcd: flags=0x0
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/1 refcnt=7
    pending: rxrpc_peer_keepalive_worker
    delayed: rxrpc_peer_keepalive_worker, rxrpc_peer_keepalive_worker, rxrpc_peer_keepalive_worker, rxrpc_peer_keepalive_worker, rxrpc_peer_keepalive_worker
workqueue bat_events: flags=0xe000a
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=56
    pending: batadv_nc_worker
    delayed: batadv_nc_worker, batadv_purge_orig, batadv_mcast_mla_update, batadv_mcast_mla_update, batadv_mcast_mla_update, batadv_mcast_mla_update, batadv_mcast_mla_update, batadv_mcast_mla_update, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_purge_orig, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_tt_purge, batadv_dat_purge, batadv_bla_periodic_work, batadv_bla_periodic_work, batadv_dat_purge, batadv_bla_periodic_work, batadv_dat_purge, batadv_bla_periodic_work, batadv_dat_purge, batadv_nc_worker, batadv_nc_worker, batadv_nc_worker, batadv_purge_orig, batadv_purge_orig, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet
, batadv_iv_send_outstanding_bat_ogm_packet, batadv_tt_purge, batadv_iv_send_outstanding_bat_ogm_packet, batadv_purge_orig, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_purge_orig, batadv_iv_send_outstanding_bat_ogm_packet, batadv_iv_send_outstanding_bat_ogm_packet, batadv_tt_purge, batadv_dat_purge, batadv_bla_periodic_work, batadv_dat_purge, batadv_bla_periodic_work, batadv_tt_purge, batadv_tt_purge, batadv_tt_purge
workqueue wg-kex-wg0: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/256 refcnt=5
    pending: wg_packet_handshake_send_worker, wg_packet_handshake_send_worker
workqueue wg-kex-wg1: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/256 refcnt=5
    pending: wg_packet_handshake_send_worker, wg_packet_handshake_send_worker
workqueue wg-kex-wg2: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/256 refcnt=5
    pending: wg_packet_handshake_send_worker, wg_packet_handshake_send_worker
workqueue wg-kex-wg0: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=4
    pending: wg_packet_handshake_send_worker
workqueue wg-kex-wg1: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=4
    pending: wg_packet_handshake_send_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-kex-wg2: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/256 refcnt=5
    pending: wg_packet_handshake_send_worker, wg_packet_handshake_send_worker
workqueue wg-kex-wg0: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-kex-wg0: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=4
    pending: wg_packet_handshake_send_worker
workqueue wg-kex-wg1: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/256 refcnt=5
    pending: wg_packet_handshake_send_worker, wg_packet_handshake_send_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-kex-wg2: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/256 refcnt=5
    in-flight: 21:wg_packet_handshake_send_worker
    pending: wg_packet_handshake_send_worker
workqueue wg-kex-wg1: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=4
    pending: wg_packet_handshake_send_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_decrypt_worker
workqueue wg-kex-wg2: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=4
    in-flight: 22113:wg_packet_handshake_send_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-kex-wg2: flags=0x6
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=4
    pending: wg_packet_handshake_send_worker
workqueue wg-kex-wg0: flags=0x24
  pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_encrypt_worker
workqueue wg-kex-wg1: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue phy3: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy4: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy5: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy6: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy7: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy8: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy9: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    in-flight: 362:ieee80211_iface_work
workqueue phy10: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy11: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy12: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy13: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue phy14: flags=0xa0002
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=4
    pending: ieee80211_iface_work
workqueue bond1: flags=0xa000a
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=5
    pending: bond_alb_monitor
    delayed: bond_mii_monitor
pool 0: cpus=0 node=0 flags=0x0 nice=0 hung=190s workers=5 idle: 3194 3002 26070 9795
pool 2: cpus=1 node=0 flags=0x1 nice=0 hung=0s workers=5 manager: 11052
pool 4: cpus=0-1 flags=0x4 nice=0 hung=0s workers=6 idle: 196 8 253

Crashes (2):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/11/17 09:23 upstream 9c87c9f41245 1bf9a662 .config console log report info ci-upstream-kasan-gce
2020/11/26 09:44 bpf 9a44bc9449cf 2f1cec62 .config console log report info ci-upstream-bpf-kasan-gce
* Struck through repros no longer work on HEAD.