prometheus-community/helm-charts

i am unable to see kube state metrics info in prometheus

ContraBoy9999 opened this issue · 0 comments

HI,
I have prometheus setup in my eks cluster but via helm. I have it working fine but i am unable to see info specefic to kube-state-metrics in prometheus.

I installed the kube-state-metrics on my eks cluster in additon to the prometheus-kube-state-metrics-xxxxxxx pod which is already running.

To fix this (i have istio running as sidecar in prometheus-kube-state-metrics-xxxxxxx pod):

  1. i created a DR between the 2 namespaces so that prometheus can communicate with kube-state metrics service
  2. I updated values.yml in prometheus as below so it can scrape those metrics

extraScrapeConfigs: - job_name: 'kube-state-metrics' metrics_path: /metrics static_configs: - targets: ['kube-state-metrics.kube-system.svc.cluster.local:8080']

My targets in prometheus are listing as DOWN for /metrics :
port 8080: server returned HTTP status 503 Service Unavailable
port 15090: server returned 404 not found

Can anyone suggest what am i doing wrong here/ Any ideas?