| e44bd8e9-a601-4e4b-9443-bd6a886590cc |
repro |
|
💥 |
KMSAN: uninit-value in fd_install |
2026/03/10 13:48 |
2026/03/11 13:04 |
2026/03/11 14:11 |
86914af9098a80da53c3c5d46be980c572ee29f8 |
Error 503, Message: This model is currently experiencing high demand. Spikes in demand are usually temporary. Please try again later., Status: UNAVAILABLE, Details: [map[@type:type.googleapis.com/google.rpc.DebugInfo detail:[ORIGINAL ERROR] generic::unavailable: Overloaded prefill queue.; Failed while executing Op 'Prefill'; Failed to close the streaming context; status = UNAVAILABLE: Overloaded prefill queue.; Failed while executing Op 'Prefill' [type.googleapis.com/stairways.orch.ErrorLoc='learning/serving/servables/wiz/orch_wiz_servable.cc:976']
=== Source Location Trace: ===
learning/brain/research/stairways/orchestrator/leaf/chain_stub.cc:125
learning/serving/servables/wiz/orch_wiz_servable.cc:1008
; Failed to run inference for model: go/debugproto
name: "prod-common-global__/aistudio/gemini-v4p1m-rev24-snowball-lc__main__/aistudio/gemini-v4p1m-rev24-snowball-lc__2026022700__prefill__variant__d76be967-e50b-41c8-931e-6559b02591d8"
version {
value: 1
}
signature_name: "serving_default"
[google.rpc.error_details_ext] { message: "This model is currently experiencing high demand. Spikes in demand are usually temporary. Please try again later." details { type_url: "type.googleapis.com/language_labs.genai.debug.GeminiApiDebugInfo" value: "\212\001\241\006\n\353\005Overloaded prefill queue.; Failed while executing Op \'Prefill\'; Failed to close the streaming context; status = UNAVAILABLE: Overloaded prefill queue.; Failed while executing Op \'Prefill\' [type.googleapis.com/stairways.orch.ErrorLoc=\'learning/serving/servables/wiz/orch_wiz_servable.cc:976\']\n=== Source Location Trace: ===\nlearning/brain/research/stairways/orchestrator/leaf/chain_stub.cc:125\nlearning/serving/servables/wiz/orch_wiz_servable.cc:1008\n; Failed to run inference for model: go/debugproto \nname: \"prod-common-global__/aistudio/gemini-v4p1m-rev24-snowball-lc__main__/aistudio/gemini-v4p1m-rev24-snowball-lc__2026022700__prefill__variant__d76be967-e50b-41c8-931e-6559b02591d8\"\nversion {\n value: 1\n}\nsignature_name: \"serving_default\"\n\0221labs/language/genai/common/error_handler.cc:290:0" } }]] |