I was using prometheus for the monitoring of pod's cpu and network usage. but the metrics like cpu_usage_seconds are not coming in prometheus.
when i checked the the kubelet target's are down.
I'm using stable/prometheus-operator from helm:
There are several ways to troubleshoot this:
Check permissions, webhooks and kube controller. Details can be found here
Check if your firewall rule is not blocking the connection (on a proper port).
Prometheus needs read access to all cluster components in order to get the metrics. Check the cluster roles.
Check the service endpoint discovery configurations in the config map.
make sure you are using the latest stable version of the Prometheus.
Please let me know if that helped.