Issue
-
Kubernetes Agent provisioning is slow / stuck causing the build queue to grow
-
Many threads are
BLOCKED
onorg.csanchez.jenkins.plugins.kubernetes.KubernetesCloud.provision
waiting on a lock onorg.csanchez.jenkins.plugins.kubernetes.KubernetesCloud
:
"Computer.threadPoolForRemoting [#11599]" #350850 daemon prio=5 os_prio=0 tid=0x00007f5e581bf800 nid=0x4f9a waiting for monitor entry [0x00007f5da6db9000] java.lang.Thread.State: BLOCKED (on object monitor) at org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud.provision(KubernetesCloud.java:539) - waiting to lock <0x00000002f33e6f38> (a org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud) [...]
Environment
-
CloudBees CI (CloudBees Core) on Modern Cloud Platforms - Managed controller
-
CloudBees CI (CloudBees Core) on Modern Cloud Platforms - Operations Center
-
CloudBees CI (CloudBees Core) on Traditional Platforms - Client controller
-
CloudBees CI (CloudBees Core) on Traditional Platforms - Operations Center
Workaround
If a core upgrade is not an option in short term, the workaround is to upgrade the kubernetes plugin to a fixed version. The fix has been backported to different baselines of the plugin:
This article is part of our Knowledge Base and is provided for guidance-based purposes only. The solutions or workarounds described here are not officially supported by CloudBees and may not be applicable in all environments. Use at your own discretion, and test changes in a safe environment before applying them to production systems.