Docker Swarm Cluster Logs with OpenObserve
TLDR arun asked how to collect logs from Docker services; Prabhat suggested using Vector or Fluentbit. arun found a ready-made solution and successfully implemented Vector.
Jun 15, 2023 (6 months ago)
docker service logs <service name>command. I will check fluentbit and vector to see if they offer anything
Elastic Agent is a process of processes which runs Filebeat, Metricbeat
Jun 16, 2023 (5 months ago)
Jun 19, 2023 (5 months ago)
Indexed 404 threads (74% resolved)
Elastic Fleet/Agents Reporting to ZincObserve
Joe inquired about using Elastic Fleet/agents with ZincObserve. Prabhat found it possible, but faced issues related to mutable data in ES indexes. Further investigation required.
Troubleshooting Openobserve Issue On Linux Machine
Sushma encountered difficulties viewing pods and creating multiple streams in Openobserve. Prabhat and Hengfei suggested upgrading the software, adjusting SQL syntax, and amending the configuration setup. Despite progress, the issue remains partially unresolved.
Setting up Fluentd with OpenObserve for Kubernetes Logging
vasanth sought help for integrating Fluentd with OpenObserve. Prabhat recommended using FluentBit or Vector instead and provided a tutorial, which resolved vasanth's issue successfully.
OpenObserve issues with FluentBit and Dashboard
Alejandro experienced issues with FluentBit losing connection with OpenObserve and discarding logs, and an error when saving a chart on the OpenObserve dashboard. Prabhat could not identify the cause of record loss. However, potential solutions were suggested to save the dashboard with a string-type filter instead of integer one.
Querying Local Storage Files and Ingesting Logs with OpenObserve
Rinshad asks about querying local storage files and ingesting logs. Prabhat suggests using parquet file format and tools like vector and fluentbit. Mark mentions Sublime's plugin for editing parquet files.