Configuring Business Logs to Different Repositories
TLDR xy asked about directing business logs to separate repositories. Ashish and Prabhat guided on configuring the log forwarder and setting up the Logstash format.
Ashish
Thu, 17 Aug 2023 08:37:38 UTCwhich log forwarder are you using for ingestion
xy
Thu, 17 Aug 2023 08:39:17 UTCthis
Ashish
Thu, 17 Aug 2023 08:40:15 UTCin URI api/{org_id}/{log stream}/_json
Ashish
Thu, 17 Aug 2023 08:40:41 UTCplease replace api/default/{log stream}/_json with desired value
xy
Thu, 17 Aug 2023 08:43:03 UTCIs there an example? I just used this and I'm not very familiar with it
Ashish
Thu, 17 Aug 2023 08:45:04 UTC```[OUTPUT] Name http Match * URI /api/default/stream1/_json```
Ashish
Thu, 17 Aug 2023 08:45:15 UTCyou can use this with rest of section from above configuration
xy
Thu, 17 Aug 2023 09:09:52 UTCneed to configure multiple inputs to distinguish different businesses and collect them as input?
Prabhat
Thu, 17 Aug 2023 09:50:29 UTCyes
xy
Thu, 17 Aug 2023 09:54:48 UTC[OUTPUT] Name es Match * Host zo1-openobserve-router.openobserve.svc.cluster.local Port 5080 Logstash_Format on Logstash_Prefix_Key $kubernetes['labels']['app'] index xiaoya Replace_Dots On Retry_Limit False path /api/default http_user xxx http_passwd xxx
xy
Thu, 17 Aug 2023 09:58:05 UTCIt seems simpler to use the ES plugin above
Prabhat
Thu, 17 Aug 2023 09:59:27 UTCyou would want to remove date from the stream name, You don't need that here
xy
Thu, 17 Aug 2023 10:02:10 UTChow to remove date from the stream name? :melting_face:
Prabhat
Thu, 17 Aug 2023 10:09:16 UTCLogstash_Format off
Prabhat
Thu, 17 Aug 2023 10:09:39 UTCyou can try that
xy
Thu, 17 Aug 2023 10:10:59 UTCThank you. i will try now
OpenObserve
Indexed 419 threads
OpenObserve is an open-source, petabyte-scale observability platform for the cloud native realm, offering a 10x cost reduction and 140x less storage use compared to competitors like Elasticsearch or Splunk. Built in Rust for exceptional performance, it offers comprehensive features like logs, metrics, traces, dashboards, and more | Knowledge Base powered by Struct.AI
View in App
xy
Thu, 17 Aug 2023 08:36:31 UTCHello, I'd like to inquire about how to record different business logs into separate log repositories. Similar to having different business logs correspond to different Elasticsearch indexes.