Deploying Metrics Dashboards for K8s

TLDR Johnson had issues deploying metrics dashboards for k8s using an example from a GitHub repo. Prabhat suggested using kube-prometheus-stack for data sending and mentioned a future update with prebuilt dashboards based on the otel-collector.

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:39:18 UTC

Hello, I'm working on deploying some metrics dashboards for k8s. I uploaded the example json ones from this but it seems like the information isn't showing.. I included some screenshots, please let me know if any other information is required, thank you!

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:40:32 UTC

These dashboards require data being sent from prometheus using kube-prometheus-stack

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:40:52 UTC

We will be shipping prebuilt dashboards based on otel-collector soon

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:40:55 UTC

like next week

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:41:35 UTC

What are you using to send metric data to OpenObserve ?

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:41:47 UTC

I'm currently using OTEL collector

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:42:11 UTC

Would there be any issues if I deploy the kube-prometheus-stack and OTEL collector?

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:42:29 UTC

no

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:42:44 UTC

you will just have duplicate data

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:42:51 UTC

in different streams

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:42:53 UTC

so no worries

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:42:59 UTC

is this a self hosted installation?

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:43:18 UTC

Correct, this is a self-hosted k8s deployment using helm

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:43:25 UTC

you will be fine

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:44:07 UTC

Got it, thank you! Amazing product btw!

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:44:17 UTC

Thank you

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:44:25 UTC

Are you using it just for metrics ?

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:44:58 UTC

Nope, we're thinking about using it for log and APM as well

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:45:10 UTC

Along with the RUM feature if that is available

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:45:19 UTC

awesome. all are available

Photo of Prabhat
Prabhat
Tue, 14 Nov 2023 23:45:37 UTC

Check out automatic instrumentation feature as well

Photo of Johnson
Johnson
Tue, 14 Nov 2023 23:46:23 UTC

Will do, thanks again!

Photo of Johnson
Johnson
Wed, 15 Nov 2023 18:36:54 UTC

Hi Prabhat, I added the kube-prometheus-stack and was able to see some data show up on the dashboards this time but there are a few panels that still doesn't show..

Photo of Prabhat
Prabhat
Wed, 15 Nov 2023 19:04:34 UTC

probably metric names might have changed in the latest kube-prometheus-stack . This is also the reason, we moved to a pre-configured otel-collector bundled by our team. So dashboarding becomes much easier. I am working on the otel-collector based dashboards. Will be ready with them soon. Will let you know here.

Photo of Johnson
Johnson
Wed, 15 Nov 2023 19:05:15 UTC

Roger that, thanks!