I'm currently trying to set up CPU-load alarming on grafana for my kubernetes cluster. For that I'd like to have a percental measure of the load (load of 3 on a 6 core CPU is 50%, load of 1 on a single core is 100%)
Unfortunately, as far as I can see there's no way to get these values directly from prometheus, but instead have to correlate the core count from kube-state-metrics with the actual load from prometheus-node-exporter.
My current attempt looks like the following:
node_load5 /
on(kubernetes_node)
group_left(kubernetes_node)
kube_node_status_capacity_cpu_cores
But it fails with the following error:
parse error at char 60: label "kubernetes_node" must not occur in ON and GROUP clause at once