Google cloud run sudden latency spikes and container instance time increase

12/3/2020

We are having recurring problems with our container instances with python running on cloud run. We currently have 20 services deployed, which run fine weeks at a time and then get sudden spikes in request latency as well as ping checks failing and the container instance time going up. We cannot see any added traffic during these spells of longer latency in our systems. Common access points such as database and cache all seem normal.

The region is europe-west1

Does anyone have any tips on what to check? Our have experienced similar problems?

Latency: enter image description here

Container instance time: enter image description here

-- Andreas
google-cloud-run
knative
kubernetes
python

1 Answer

1/12/2021

I had to buy support for Google Cloud to get a good answer to this. They told me to make adjustment to my cloud service instances, but none to any effect. They later admitted that this was due to a problem on their end. It is a shame that you as a user do not get any feedback on problems like these when using the Google Cloud Platform, a simple notification in the Google Cloud console for affected users would be of great help, but I think they may like to cover these things up as to not worsen the service accessibility numbers.

-- Andreas
Source: StackOverflow