Discussing Log Level Metadata Storage and Restoration in ETCD
TLDR JinMing inquired about log level metadata storage in ETCD. Prabhat explained that even at PB scale ETCD usage should be low. They also advised on regular backups for data restoration.
Aug 14, 2023 (3 months ago)
JinMing
02:29 AMPrabhat
02:30 AMJinMing
02:32 AMPrabhat
03:08 AMJinMing
06:11 AMJinMing
06:40 AMPrabhat
10:06 AMOpenObserve
Indexed 406 threads (74% resolved)
Similar Threads
Postgres Mode and etcd in Cluster Sync/State
Edgars inquired about the necessity of etcd in postgres mode. Hengfei confirmed its use and discussed potential future changes.
Discussion about Log Data as Big Data Storage
d daniel inquired about using logs for big data storage. Prabhat explained it's possible, but with limitations. No plans exist for ODBC/JDBC addition. The log data uses a custom DB engine.
Connectivity Testing Issues and Solutions with OpenObserve Router
Dylan experienced connectivity issues while testing OpenObserve router. Suggested by Prabhat regarding etcd issues and possibility of Istio service mesh causing connectivity problems. Reinstallation and increasing memory were also suggested but issue remained unresolved.