Setting up Fluentd with OpenObserve for Kubernetes Logging

TLDR vasanth sought help for integrating Fluentd with OpenObserve. Prabhat recommended using FluentBit or Vector instead and provided a tutorial, which resolved vasanth's issue successfully.

Photo of vasanth
vasanth
Sat, 03 Jun 2023 12:07:51 UTC

Hi Everyone! is there a guide on setting up the fluentd with openobserve? I got the openobserve up and running refering to the docs but dont see a way to forward the fluentd to talk to opneobserve, trying to use any pointers or repo will help

Photo of Prabhat
Prabhat
Sat, 03 Jun 2023 12:09:31 UTC

Hey Vasanth, Any specific preference for fluentd? We generally recommend fluentbit or vector as they are faster and require much less resources

Photo of vasanth
vasanth
Sat, 03 Jun 2023 12:41:35 UTC

Hi Prabhat, Nope, I can use either of it,

Photo of Prabhat
Prabhat
Sat, 03 Jun 2023 12:42:28 UTC

cool. Let me write a quick tutorial for it. I guess you will not be the last person to ask for it :slightly_smiling_face:

Photo of vasanth
vasanth
Sat, 03 Jun 2023 12:43:52 UTC

That will be very much helpful. Agreed many will be looking for it..

Photo of Prabhat
Prabhat
Sat, 03 Jun 2023 12:44:34 UTC

You want it in the context of kubernetes. right?

Photo of Prabhat
Prabhat
Sat, 03 Jun 2023 12:45:24 UTC

as in capture all the logs from a kubernetes cluster and send it to OpenObserve

Photo of vasanth
vasanth
Sat, 03 Jun 2023 12:50:42 UTC

Yes, exactly

Photo of Prabhat
Prabhat
Sun, 04 Jun 2023 02:29:24 UTC

Here is a blog that should get you going -

Photo of vasanth
vasanth
Sun, 04 Jun 2023 03:53:57 UTC

That’s fantastic! Thank you very much. Will try this and let you know how it goes..

Photo of vasanth
vasanth
Sun, 04 Jun 2023 23:51:25 UTC

Prabhat Was able to get the logs working.. following the blog. Simple and clear instructions. will keep you posted on further developments. Thanks a lot for quickly getting this post. one small typo in the doc- configuration is mis-spelled.

Photo of Prabhat
Prabhat
Sun, 04 Jun 2023 23:56:32 UTC

Am glad that you were able to get it working. Thanks for pointing the typo. Fixed it.

Photo of Prabhat
Prabhat
Sun, 04 Jun 2023 23:57:06 UTC

how is the resource utilization? CPU and RAM usage? Do you plan to use functions?

Photo of vasanth
vasanth
Tue, 06 Jun 2023 02:29:30 UTC

Hi Prabhat I am still exploring the openobserv give me day or two will let you know