Setting up Fluentd with OpenObserve for Kubernetes Logging
TLDR vasanth sought help for integrating Fluentd with OpenObserve. Prabhat recommended using FluentBit or Vector instead and provided a tutorial, which resolved vasanth's issue successfully.
Prabhat
Sat, 03 Jun 2023 12:09:31 UTCHey Vasanth, Any specific preference for fluentd? We generally recommend fluentbit or vector as they are faster and require much less resources
vasanth
Sat, 03 Jun 2023 12:41:35 UTCHi Prabhat, Nope, I can use either of it,
Prabhat
Sat, 03 Jun 2023 12:42:28 UTCcool. Let me write a quick tutorial for it. I guess you will not be the last person to ask for it :slightly_smiling_face:
vasanth
Sat, 03 Jun 2023 12:43:52 UTCThat will be very much helpful. Agreed many will be looking for it..
Prabhat
Sat, 03 Jun 2023 12:44:34 UTCYou want it in the context of kubernetes. right?
Prabhat
Sat, 03 Jun 2023 12:45:24 UTCas in capture all the logs from a kubernetes cluster and send it to OpenObserve
vasanth
Sat, 03 Jun 2023 12:50:42 UTCYes, exactly
Prabhat
Sun, 04 Jun 2023 02:29:24 UTCHere is a blog that should get you going -
vasanth
Sun, 04 Jun 2023 03:53:57 UTCThat’s fantastic! Thank you very much. Will try this and let you know how it goes..
vasanth
Sun, 04 Jun 2023 23:51:25 UTCPrabhat Was able to get the logs working.. following the blog. Simple and clear instructions. will keep you posted on further developments. Thanks a lot for quickly getting this post. one small typo in the doc- configuration is mis-spelled.
Prabhat
Sun, 04 Jun 2023 23:56:32 UTCAm glad that you were able to get it working. Thanks for pointing the typo. Fixed it.
Prabhat
Sun, 04 Jun 2023 23:57:06 UTChow is the resource utilization? CPU and RAM usage? Do you plan to use functions?
vasanth
Tue, 06 Jun 2023 02:29:30 UTCHi Prabhat I am still exploring the openobserv give me day or two will let you know
OpenObserve
Indexed 419 threads
OpenObserve is an open-source, petabyte-scale observability platform for the cloud native realm, offering a 10x cost reduction and 140x less storage use compared to competitors like Elasticsearch or Splunk. Built in Rust for exceptional performance, it offers comprehensive features like logs, metrics, traces, dashboards, and more | Knowledge Base powered by Struct.AI
View in App
vasanth
Sat, 03 Jun 2023 12:07:51 UTCHi Everyone! is there a guide on setting up the fluentd with openobserve? I got the openobserve up and running refering to the docs but dont see a way to forward the fluentd to talk to opneobserve, trying to use any pointers or repo will help