syzbot


panic: Sentry detected stuck tasks

Status: fixed on 2020/10/03 12:41
Reported-by: syzbot+7837fc75b651cb8b30de@syzkaller.appspotmail.com
Fix commit: de85b045d42f kvm/x86: handle a case when interrupts are enabled in the kernel space
First crash: 1535d, last: 1515d
Duplicate bugs (25)
duplicates (25):
Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
panic: Sentry detected 21 stuck task(s): 1 1539d 1535d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 9 stuck task(s): 15 1537d 1615d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 10 stuck task(s): 8 1538d 1572d 26/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 23 stuck task(s): 1 1542d 1535d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 13 stuck task(s): (2) 7 1537d 1535d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 8 stuck task(s): 9 1539d 1657d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 2 stuck task(s): 1182 1536d 1719d 0/26 closed as dup on 2020/09/13 08:13
panic: Sentry detected 15 stuck task(s): 3 1540d 1535d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 37 stuck task(s): 1 1561d 1554d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 19 stuck task(s): 5 1539d 1634d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 12 stuck task(s): 5 1538d 1630d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 18 stuck task(s): 1 1558d 1534d 0/26 closed as dup on 2020/09/15 04:25
panic: Sentry detected 14 stuck task(s): 2 1557d 1575d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 16 stuck task(s): 2 1539d 1538d 0/26 closed as dup on 2020/09/13 08:10
panic: Sentry detected 5 stuck task(s): 32 1538d 1708d 0/26 closed as dup on 2020/09/13 08:13
panic: Sentry detected 1 stuck task(s): (2) C 66 1542d 1618d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 25 stuck task(s): 1 1541d 1535d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 22 stuck task(s): 1 1558d 1534d 0/26 closed as dup on 2020/09/15 04:25
panic: Sentry detected 7 stuck task(s): (2) 16 1538d 1594d 0/26 closed as dup on 2020/09/13 08:11
panic: Sentry detected 11 stuck task(s): 9 1539d 1626d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 3 stuck task(s): 80 1539d 1718d 0/26 closed as dup on 2020/09/13 08:13
panic: Sentry detected 39 stuck task(s): 1 1540d 1535d 0/26 closed as dup on 2020/09/13 08:21
panic: Sentry detected 6 stuck task(s): 24 1538d 1660d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 4 stuck task(s): (2) C 112 1541d 1702d 0/26 closed as dup on 2020/09/13 08:12
panic: Sentry detected 17 stuck task(s): syz 2 1542d 1583d 0/26 closed as dup on 2020/09/13 08:11
Similar bugs (22)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
gvisor panic: Sentry detected stuck tasks (16) 5 901d 974d 14/26 fixed on 2022/06/10 10:13
gvisor panic: Sentry detected stuck tasks (9) 9 1369d 1370d 14/26 fixed on 2021/02/26 03:02
gvisor panic: Sentry detected stuck tasks (14) 20 1090d 1136d 14/26 fixed on 2021/12/02 12:02
gvisor panic: Sentry detected stuck tasks (17) C 822 557d 822d 26/26 fixed on 2023/05/19 14:28
gvisor panic: Sentry detected stuck tasks (12) 2 1167d 1167d 14/26 fixed on 2021/09/17 01:50
gvisor panic: Sentry detected stuck tasks (20) C 895 466d 468d 26/26 fixed on 2023/08/19 00:55
gvisor panic: Sentry detected stuck tasks (6) syz 714 1404d 1455d 14/26 fixed on 2021/01/22 19:49
gvisor panic: Sentry detected stuck tasks (7) syz 2567 1372d 1403d 14/26 fixed on 2021/02/23 13:36
gvisor panic: Sentry detected stuck tasks (4) C 5 1469d 1470d 0/26 fixed on 2020/11/18 07:03
gvisor panic: Sentry detected stuck tasks (22) 5 416d 417d 26/26 fixed on 2023/10/07 05:04
gvisor panic: Sentry detected stuck tasks (8) C 64 1370d 1371d 14/26 fixed on 2021/02/25 13:46
gvisor panic: Sentry detected stuck tasks (13) 1 1166d 1166d 14/26 fixed on 2021/09/27 21:02
gvisor panic: Sentry detected stuck tasks (10) C 264 1316d 1369d 14/26 fixed on 2021/04/20 00:15
gvisor panic: Sentry detected stuck tasks (11) C 31 1182d 1309d 14/26 fixed on 2021/09/03 10:11
gvisor panic: Sentry detected stuck tasks (3) C 180 1470d 1474d 0/26 fixed on 2020/11/17 10:52
gvisor panic: Sentry detected stuck tasks (21) 64 417d 465d 26/26 fixed on 2023/10/05 23:05
gvisor panic: Sentry detected stuck tasks (2) C 951 1474d 1515d 0/26 fixed on 2020/11/13 09:22
gvisor panic: Sentry detected stuck tasks (5) syz 83 1456d 1469d 0/26 fixed on 2020/12/01 11:18
gvisor panic: Sentry detected stuck tasks (15) C 2582 1010d 1087d 14/26 fixed on 2022/02/25 14:00
gvisor panic: Sentry detected stuck tasks (24) C 13 404d 410d 26/26 fixed on 2023/10/19 08:45
gvisor panic: Sentry detected stuck tasks (23) C 23 411d 416d 26/26 fixed on 2023/10/12 20:28
gvisor panic: Sentry detected stuck tasks (18) C 625 498d 557d 26/26 fixed on 2023/07/19 00:35

Sample crash report:
panic: Sentry detected 1 stuck task(s):
	Task tid: 19 (0x13), entered RunSys state 3m23.59s ago.
Search for '(*Task).run(0x..., 0x<tid>)' in the stack dump to find the offending goroutine
Stack for running G's are skipped while panicking.

goroutine 173 [running]:
panic(0xeb17a0, 0xc0001980e0)
	GOROOT/src/runtime/panic.go:1064 +0x46d fp=0xc000aadc08 sp=0xc000aadb50 pc=0x43438d
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).doAction(0xc000133b80, 0x1, 0x1, 0xc000aadd70)
	pkg/sentry/watchdog/watchdog.go:386 +0x57d fp=0xc000aadd00 sp=0xc000aadc08 pc=0xa9306d
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).report(0xc000133b80, 0xc000332240, 0x14701, 0xce9f8bc400)
	pkg/sentry/watchdog/watchdog.go:345 +0x311 fp=0xc000aade38 sp=0xc000aadd00 pc=0xa92a31
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).runTurn(0xc000133b80)
	pkg/sentry/watchdog/watchdog.go:326 +0x4b4 fp=0xc000aadf40 sp=0xc000aade38 pc=0xa92644
gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).loop(0xc000133b80)
	pkg/sentry/watchdog/watchdog.go:261 +0x42 fp=0xc000aadfd8 sp=0xc000aadf40 pc=0xa920b2
runtime.goexit()
	src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000aadfe0 sp=0xc000aadfd8 pc=0x467da1
created by gvisor.dev/gvisor/pkg/sentry/watchdog.(*Watchdog).Start
	pkg/sentry/watchdog/watchdog.go:212 +0x1b7

Crashes (506):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/09/14 08:11 gvisor b6ca96b9b9e7 2d3cdd63 .config console log report syz C ci-gvisor-main
2020/09/14 05:35 gvisor b6ca96b9b9e7 2d3cdd63 .config console log report syz C ci-gvisor-ptrace-proxy-sandbox-race
2020/10/03 11:48 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-main
2020/10/03 10:30 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/03 09:00 gvisor 0cea6472188e 2653fa43 .config console log report info ci-gvisor-kvm-proxy-overlay-sandbox
2020/10/03 07:22 gvisor 0cea6472188e 2653fa43 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/03 04:21 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host-race
2020/10/03 01:21 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/03 00:18 gvisor 0cea6472188e 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host-race
2020/10/02 23:13 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 21:46 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/02 19:38 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-main
2020/10/02 17:58 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 16:43 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-main
2020/10/02 16:20 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-main
2020/10/02 14:44 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/02 10:27 gvisor 7f39d5342873 062c9832 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 08:47 gvisor 7f39d5342873 9602ddf4 .config console log report info ci-gvisor-main
2020/10/02 07:37 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-kvm-proxy-overlay-sandbox
2020/10/02 06:20 gvisor 7f39d5342873 9602ddf4 .config console log report info ci-gvisor-main
2020/10/02 06:16 gvisor 7f39d5342873 9602ddf4 .config console log report info ci-gvisor-main
2020/10/02 05:13 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/02 03:46 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/02 02:19 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/01 22:39 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-main
2020/10/01 20:56 gvisor cb41f6703160 9602ddf4 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 19:50 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 18:11 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 18:01 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 16:24 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-kvm-direct-sandbox
2020/10/01 14:31 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 13:17 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 11:20 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 10:18 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 09:08 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 08:41 gvisor cb41f6703160 4103fce0 .config console log report info ci-gvisor-main
2020/10/01 07:38 gvisor cb41f6703160 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 07:12 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 05:36 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-ptrace-direct-overlay-host
2020/10/01 04:23 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 03:15 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/10/01 03:00 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 01:19 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/10/01 00:08 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 23:12 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 20:52 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 20:43 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 19:25 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 18:22 gvisor 3ef549b67f83 a9767fb2 .config console log report info ci-gvisor-main
2020/09/30 17:22 gvisor e5ece9aea730 8516f6d3 .config console log report info ci-gvisor-ptrace-proxy-sandbox-race
2020/09/30 16:18 gvisor e5ece9aea730 8516f6d3 .config console log report info ci-gvisor-main
2020/09/13 01:32 gvisor 3ca73841d7ec ad54dc7a .config console log report ci-gvisor-ptrace-direct-overlay-host
* Struck through repros no longer work on HEAD.