panic: Sentry detected stuck tasks

Status: fixed on 2020/10/03 12:41
Reported-by: syzbot+7837fc75b651cb8b30de@syzkaller.appspotmail.com
Fix commit: de85b045d42f kvm/x86: handle a case when interrupts are enabled in the kernel space
First crash: 2238d, last: 2218d
▶ ▼ Duplicate bugs (25)
Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
panic: Sentry detected 21 stuck task(s): 2 1 2242d 2238d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 9 stuck task(s): 2 15 2240d 2318d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 10 stuck task(s): 2 8 2241d 2275d 26/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 23 stuck task(s): 2 1 2245d 2238d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 13 stuck task(s): (2) 2 7 2240d 2239d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 8 stuck task(s): 2 9 2243d 2360d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 2 stuck task(s): 2 1182 2239d 2422d 0/26 closed as dup on 2020/09/13 08:13
panic: Sentry detected 15 stuck task(s): 2 3 2243d 2239d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 37 stuck task(s): 2 1 2265d 2257d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 19 stuck task(s): 2 5 2242d 2338d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 12 stuck task(s): 2 5 2241d 2334d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 18 stuck task(s): 2 1 2262d 2237d 0/26 closed as dup on 2020/09/15 04:25
panic: Sentry detected 14 stuck task(s): 2 2 2260d 2279d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 16 stuck task(s): 2 2 2243d 2241d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 5 stuck task(s): 2 32 2241d 2411d 0/26 closed as dup on 2020/09/13 08:13
panic: Sentry detected 1 stuck task(s): (2) 2 syz, C 66 2245d 2321d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 25 stuck task(s): 2 1 2244d 2238d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 22 stuck task(s): 2 1 2261d 2237d 0/26 closed as dup on 2020/09/15 04:25
panic: Sentry detected 7 stuck task(s): (2) 2 16 2241d 2297d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 11 stuck task(s): 2 9 2242d 2329d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 3 stuck task(s): 2 80 2243d 2422d 0/26 closed as dup on 2020/09/13 08:13
panic: Sentry detected 39 stuck task(s): 2 1 2244d 2238d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 6 stuck task(s): 2 24 2241d 2363d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 4 stuck task(s): (2) 2 syz, C 112 2245d 2405d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 17 stuck task(s): 2 syz 2 2245d 2287d 0/26 closed as dup on 2020/09/13 08:11
▶ ▼ Similar bugs (34)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
gvisor panic: Sentry detected stuck tasks (16) 2 5 1604d 1677d 14/26 fixed on 2022/06/10 10:13
gvisor panic: Sentry detected stuck tasks (9) 2 9 2072d 2073d 14/26 fixed on 2021/02/26 03:02
gvisor panic: Sentry detected stuck tasks (14) 2 20 1794d 1839d 14/26 fixed on 2021/12/02 12:02
gvisor panic: Sentry detected stuck tasks (17) 2 syz, C 822 1260d 1526d 26/26 fixed on 2023/05/19 14:28
gvisor panic: Sentry detected stuck tasks (12) 2 2 1870d 1870d 14/26 fixed on 2021/09/17 01:50
gvisor panic: Sentry detected stuck tasks (20) 2 syz, C 895 1169d 1172d 26/26 fixed on 2023/08/19 00:55
gvisor panic: Sentry detected stuck tasks (6) 2 syz 714 2107d 2159d 14/26 fixed on 2021/01/22 19:49
gvisor panic: Sentry detected stuck tasks (7) 2 syz 2567 2075d 2106d 14/26 fixed on 2021/02/23 13:36
gvisor panic: Sentry detected stuck tasks (4) 2 syz, C 5 2172d 2173d 0/26 fixed on 2020/11/18 07:03
gvisor panic: Sentry detected stuck tasks (22) 2 5 1119d 1120d 26/26 fixed on 2023/10/07 05:04
gvisor panic: Sentry detected stuck tasks (8) 2 syz, C 64 2073d 2075d 14/26 fixed on 2021/02/25 13:46
gvisor panic: Sentry detected stuck tasks (13) 2 1 1869d 1869d 14/26 fixed on 2021/09/27 21:02
gvisor panic: Sentry detected stuck tasks (10) 2 syz, C 264 2020d 2072d 14/26 fixed on 2021/04/20 00:15
gvisor panic: Sentry detected stuck tasks (26) 2 syz, C 17 688d 689d 26/26 fixed on 2024/12/11 10:55
gvisor panic: Sentry detected stuck tasks (11) 2 syz, C 31 1886d 2013d 14/26 fixed on 2021/09/03 10:11
gvisor panic: Sentry detected stuck tasks (35) 2 syz 41 199d 252d 26/26 fixed on 2026/04/14 23:49
gvisor panic: Sentry detected stuck tasks (3) 2 syz, C 180 2173d 2177d 0/26 fixed on 2020/11/17 10:52
gvisor panic: Sentry detected stuck tasks (31) 2 3 408d 449d 26/26 fixed on 2025/09/19 06:07
gvisor panic: Sentry detected stuck tasks (28) 2 syz, C 11282 554d 658d 26/26 fixed on 2025/04/24 21:44
gvisor panic: Sentry detected stuck tasks (21) 2 64 1121d 1168d 26/26 fixed on 2023/10/05 23:05
gvisor panic: Sentry detected stuck tasks (2) 2 syz, C 951 2177d 2218d 0/26 fixed on 2020/11/13 09:22
gvisor panic: Sentry detected stuck tasks (5) 2 syz 83 2159d 2172d 0/26 fixed on 2020/12/01 11:18
gvisor panic: Sentry detected stuck tasks (33) 2 syz, C 13 346d 347d 26/26 fixed on 2025/11/19 02:01
gvisor panic: Sentry detected stuck tasks (37) 2 11 1d14h 13d 0/26 moderation: reported on 2026/10/17 00:44
gvisor panic: Sentry detected stuck tasks (27) 2 syz, C 14 665d 685d 26/26 fixed on 2025/01/07 21:12
gvisor panic: Sentry detected stuck tasks (32) 2 5 354d 393d 26/26 fixed on 2025/11/12 21:14
gvisor panic: Sentry detected stuck tasks (36) 2 8 43d 66d 26/26 fixed on 2026/09/18 11:33
gvisor panic: Sentry detected stuck tasks (15) 2 syz, C 2582 1713d 1790d 14/26 fixed on 2022/02/25 14:00
gvisor panic: Sentry detected stuck tasks (34) 2 2 289d 295d 26/26 fixed on 2026/01/14 10:50
gvisor panic: Sentry detected stuck tasks (25) 2 syz, C 78 690d 719d 26/26 fixed on 2024/12/09 18:01
gvisor panic: Sentry detected stuck tasks (29) 2 syz, C 51 549d 553d 26/26 fixed on 2025/04/30 13:05
gvisor panic: Sentry detected stuck tasks (24) 2 syz, C 13 1107d 1113d 26/26 fixed on 2023/10/19 08:45
gvisor panic: Sentry detected stuck tasks (23) 2 syz, C 23 1114d 1119d 26/26 fixed on 2023/10/12 20:28
gvisor panic: Sentry detected stuck tasks (18) 2 syz, C 625 1201d 1260d 26/26 fixed on 2023/07/19 00:35

Sample crash report:
panic: Sentry detected 1 stuck task(s):
	Task tid: 19 (0x13), entered RunSys state 3m23.59s ago.
Search for '(*Task).run(0x..., 0x<tid>)' in the stack dump to find the offending goroutine
Stack for running G's are skipped while panicking.

goroutine 173 [running]:
panic(0xeb17a0, 0xc0001980e0)
	GOROOT/src/runtime/panic.go:1064 +0x46d fp=0xc000aadc08 sp=0xc000aadb50 pc=0x43438d
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).doAction(0xc000133b80, 0x1, 0x1, 0xc000aadd70)
	pkg/sentry/watchdog/watchdog.go:386 +0x57d fp=0xc000aadd00 sp=0xc000aadc08 pc=0xa9306d
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).report(0xc000133b80, 0xc000332240, 0x14701, 0xce9f8bc400)
	pkg/sentry/watchdog/watchdog.go:345 +0x311 fp=0xc000aade38 sp=0xc000aadd00 pc=0xa92a31
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).runTurn(0xc000133b80)
	pkg/sentry/watchdog/watchdog.go:326 +0x4b4 fp=0xc000aadf40 sp=0xc000aade38 pc=0xa92644
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).loop(0xc000133b80)
	pkg/sentry/watchdog/watchdog.go:261 +0x42 fp=0xc000aadfd8 sp=0xc000aadf40 pc=0xa920b2
runtime.goexit()
	src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000aadfe0 sp=0xc000aadfd8 pc=0x467da1
created by gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).Start
	pkg/sentry/watchdog/watchdog.go:212 +0x1b7

Crashes (506):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/09/14 08:11 gvisor b6ca96b9b9e7 2d3cdd63 .config console log report syz C ci-gvisor-main
2020/09/14 05:35 gvisor b6ca96b9b9e7 2d3cdd63 .config console log report syz C ci-gvisor-ptrace-proxy-sandbox-race
2020/10/03 11:48 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-main
2020/10/03 10:30 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/03 09:00 gvisor 0cea6472188e 2653fa43 .config console log report info ci-gvisor-kvm-proxy-overlay-sandbox
2020/10/03 07:22 gvisor 0cea6472188e 2653fa43 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/03 04:21 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host-race
2020/10/03 01:21 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/03 00:18 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host-race
2020/10/02 23:13 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 21:46 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/02 19:38 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-main
2020/10/02 17:58 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 16:43 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-main
2020/10/02 16:20 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-main
2020/10/02 14:44 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/02 10:27 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 08:47 gvisor 7f39d5342873 9602ddf4 .config console log report info ci-gvisor-main
2020/10/02 07:37 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-kvm-proxy-overlay-sandbox
2020/10/02 06:20 gvisor 7f39d5342873 9602ddf4 .config console log report info ci-gvisor-main
2020/10/02 06:16 gvisor 7f39d5342873 9602ddf4 .config console log report info ci-gvisor-main
2020/10/02 05:13 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/02 03:46 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 02:19 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/01 22:39 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-main
2020/10/01 20:56 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 19:50 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 18:11 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 18:01 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 16:24 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/01 14:31 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 13:17 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 11:20 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 10:18 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 09:08 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 08:41 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 07:38 gvisor cb41f6703160 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 07:12 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 05:36 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/01 04:23 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 03:15 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 03:00 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 01:19 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 00:08 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 23:12 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 20:52 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 20:43 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 19:25 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 18:22 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 17:22 gvisor e5ece9aea730 8516f6d3 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/09/30 16:18 gvisor e5ece9aea730 8516f6d3 .config console log report info ci-gvisor-main
2020/09/13 01:32 gvisor 3ca73841d7ec ad54dc7a .config console log report ci-gvisor-ptrace-direct-overlay-host
* Struck through repros no longer work on HEAD.