syzbot


panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:

Status: fixed on 2022/12/14 16:07
Fix commit: 70be2fc8a772 Remove unsetting route's cached neighbor entry in link res callback.
First crash: 719d, last: 713d

Sample crash report:
panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
goroutine 311 [running]:
gvisor.dev/gvisor/pkg/sync/locking.(*ancestorsAtomicPtrMap).RangeRepeatable(0xc0002c0380, 0xc000a8cfe0)
	bazel-out/k8-fastbuild-ST-3dcbe13c9b87/bin/pkg/sync/locking/atomicptrmap_ancestors_unsafe.go:441 +0x1dc
gvisor.dev/gvisor/pkg/sync/locking.checkLock(0xc0002c0000, 0xc0002c0360, {0xc0006cf298, 0x1, 0x1})
	pkg/sync/locking/lockdep.go:98 +0x373
gvisor.dev/gvisor/pkg/sync/locking.checkLock.func1(0xc0002c0160?, 0xc000a8d108?)
	pkg/sync/locking/lockdep.go:101 +0x65
gvisor.dev/gvisor/pkg/sync/locking.(*ancestorsAtomicPtrMap).RangeRepeatable(0xc0002c0140, 0xc000a8d1e0)
	bazel-out/k8-fastbuild-ST-3dcbe13c9b87/bin/pkg/sync/locking/atomicptrmap_ancestors_unsafe.go:441 +0x1dc
gvisor.dev/gvisor/pkg/sync/locking.checkLock(0xc0002c0000, 0xc0002c0120, {0x0, 0x0, 0x0})
	pkg/sync/locking/lockdep.go:98 +0x373
gvisor.dev/gvisor/pkg/sync/locking.AddGLock(0xc0002c0000, 0xffffffffffffffff)
	pkg/sync/locking/lockdep.go:126 +0x28c
gvisor.dev/gvisor/pkg/tcpip/stack.(*neighborCacheRWMutex).Lock(0xc000556e30)
	bazel-out/k8-fastbuild-ST-3dcbe13c9b87/bin/pkg/tcpip/stack/neighbor_cache_mutex.go:31 +0x45
gvisor.dev/gvisor/pkg/tcpip/stack.(*neighborCache).clear(0xc000556e10)
	pkg/tcpip/stack/neighbor_cache.go:238 +0x5c
gvisor.dev/gvisor/pkg/tcpip/stack.(*nic).clearNeighbors(0xc000b72c00, 0x922ae0?)
	pkg/tcpip/stack/nic.go:658 +0x8f
gvisor.dev/gvisor/pkg/tcpip/stack.(*nic).disableLocked(0xc000b72c00)
	pkg/tcpip/stack/nic.go:262 +0x145
gvisor.dev/gvisor/pkg/tcpip/stack.(*nic).remove(0xc000b72c00)
	pkg/tcpip/stack/nic.go:304 +0xac
gvisor.dev/gvisor/pkg/tcpip/stack.(*Stack).removeNICLocked(0xc000446300, 0x4)
	pkg/tcpip/stack/stack.go:979 +0x225
gvisor.dev/gvisor/pkg/tcpip/stack.(*Stack).RemoveNIC(0xc000446300, 0x1132979?)
	pkg/tcpip/stack/stack.go:949 +0xad
gvisor.dev/gvisor/pkg/tcpip/link/tun.(*tunEndpoint).DecRef.func1()
	pkg/tcpip/link/tun/device.go:347 +0x89
gvisor.dev/gvisor/pkg/tcpip/link/tun.(*tunEndpointRefs).DecRef(0xc0001bc080, 0xc000a8d8f0)
	bazel-out/k8-fastbuild-ST-3dcbe13c9b87/bin/pkg/tcpip/link/tun/tun_endpoint_refs.go:131 +0x5f
gvisor.dev/gvisor/pkg/tcpip/link/tun.(*tunEndpoint).DecRef(0xc0001bc080, {0xc00070c890?, 0xc0006cf200?})
	pkg/tcpip/link/tun/device.go:345 +0x4d
gvisor.dev/gvisor/pkg/tcpip/link/tun.(*Device).Release(0xc000490128, {0x79cc78, 0xc000273500})
	pkg/tcpip/link/tun/device.go:82 +0x1c6
gvisor.dev/gvisor/pkg/sentry/devices/tundev.(*tunFD).Release(0xc0004900c0, {0x79cc78, 0xc000273500})
	pkg/sentry/devices/tundev/tundev.go:117 +0x47
gvisor.dev/gvisor/pkg/sentry/vfs.(*FileDescription).DecRef.func1()
	pkg/sentry/vfs/file_description.go:192 +0x348
gvisor.dev/gvisor/pkg/sentry/vfs.(*FileDescriptionRefs).DecRef(0xc0004900c0, 0xc000a8db68)
	bazel-out/k8-fastbuild-ST-3dcbe13c9b87/bin/pkg/sentry/vfs/file_description_refs.go:131 +0x5f
gvisor.dev/gvisor/pkg/sentry/vfs.(*FileDescription).DecRef(0xc0004900c0, {0x79cc78, 0xc000273500})
	pkg/sentry/vfs/file_description.go:161 +0x6f
gvisor.dev/gvisor/pkg/sentry/kernel.(*FDTable).drop(0xc000243ed0?, {0x79cc78, 0xc000273500}, 0xc0004900c0)
	pkg/sentry/kernel/fd_table.go:137 +0x1ed
gvisor.dev/gvisor/pkg/sentry/kernel.(*FDTable).RemoveIf(0xc000243ec0, {0x79cc78, 0xc000273500}, 0x4d4690)
	pkg/sentry/kernel/fd_table.go:501 +0x150
gvisor.dev/gvisor/pkg/sentry/kernel.(*FDTable).DecRef.func1()
	pkg/sentry/kernel/fd_table.go:152 +0x54
gvisor.dev/gvisor/pkg/sentry/kernel.(*FDTableRefs).DecRef(0xc000243ec0, 0xc000a8dd88)
	bazel-out/k8-fastbuild-ST-3dcbe13c9b87/bin/pkg/sentry/kernel/fd_table_refs.go:131 +0x5f
gvisor.dev/gvisor/pkg/sentry/kernel.(*FDTable).DecRef(0xc000243ec0, {0x79cc78, 0xc000273500})
	pkg/sentry/kernel/fd_table.go:151 +0x6f
gvisor.dev/gvisor/pkg/sentry/kernel.(*runExitMain).execute(0xc000273500, 0xc000273500)
	pkg/sentry/kernel/task_exit.go:281 +0x797
gvisor.dev/gvisor/pkg/sentry/kernel.(*Task).run(0xc000273500, 0xf)
	pkg/sentry/kernel/task_run.go:94 +0x3a2
created by gvisor.dev/gvisor/pkg/sentry/kernel.(*Task).Start
	pkg/sentry/kernel/task_start.go:377 +0x1ad

Crashes (356):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2022/12/08 16:54 gvisor 2e0cc62d827d 1034e5fa .config console log report syz C ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/08 11:27 gvisor 2e0cc62d827d 1034e5fa .config console log report syz C ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 18:46 gvisor 368e85414697 f6511626 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 16:42 gvisor 368e85414697 f6511626 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 16:32 gvisor 368e85414697 f6511626 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 15:30 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 14:29 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 13:15 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 12:13 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 10:35 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 08:32 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 05:05 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/13 03:27 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 23:50 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 22:40 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 20:35 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 19:25 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 16:47 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 14:39 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 09:59 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 06:26 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 05:06 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 03:24 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 03:21 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 01:53 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/12 00:48 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 21:20 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 20:08 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 18:21 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 17:16 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 15:56 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 15:56 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 14:07 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 11:06 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 09:44 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 09:06 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 05:53 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/11 00:04 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 18:54 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 14:13 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 11:43 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 11:38 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 10:30 gvisor 368e85414697 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 09:06 gvisor 1cbabd822597 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 07:34 gvisor 1cbabd822597 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 06:14 gvisor 1cbabd822597 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 02:23 gvisor 1cbabd822597 67be1ae7 .config console log report info ci-gvisor-ptrace-1-race panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/10 00:22 gvisor 1cbabd822597 67be1ae7 .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
2022/12/08 09:07 gvisor 2e0cc62d827d 1034e5fa .config console log report info ci-gvisor-ptrace-2-race-cover panic: WARNING: circular locking detected: stack.nicRWMutex -> stack.neighborCacheRWMutex:
* Struck through repros no longer work on HEAD.