Discussion on Real-Time Alerts and Conditions
TLDR Jurgen wanted alerts for instance value changes in metrics. Prabhat recommended using external tools as OpenObserve currently lacks this functionality. Ashish confirmed the lack of complete data in alerts and promised potential enhancement in OpenObserve.
1
Jul 05, 2023 (5 months ago)
Jurgen
09:08 AMprobe_success
on any specific instance. Currently, I only seem to be able to raise an alert when value=0
, but that raises the same alert every few seconds when blackbox pings the service every few seconds. Is that possible somehow?Prabhat
09:29 AMJurgen
09:50 AMPrabhat
01:22 PM1. Alerting based on a condition happening
2. Alerting based on change condition happening and then reverting. eg. status was up (1) and then changed to down (0) we want to get alerted. We also want to get alerted when the system came back up.
Prabhat
01:28 PMJurgen
02:08 PMPrabhat
02:08 PMPrabhat
02:08 PMJurgen
02:09 PMPrabhat
02:10 PMPrabhat
02:13 PMsend_resolved: true
for enabling this
Jul 06, 2023 (5 months ago)
Jurgen
07:36 AM• stream_name
• org_name
• alert_name
• alert_type
• timestamp
Is that correct? Or is there a way to access data from the row which triggered the alert?
Ashish
10:36 AMAshish
10:37 AMAshish
10:37 AMAshish
10:38 AMJurgen
10:39 AMAshish
10:40 AMAshish
10:40 AMAshish
10:41 AMAshish
10:41 AMJurgen
11:05 AMprobe_success=0
we want an alert being issued. I assume that Prometheus sends records from a number of different probes at once, so each of which would have to raise an alert, if they were not successfulAshish
11:18 AM1
OpenObserve
Indexed 406 threads (74% resolved)
Similar Threads
Erroneous Triggering of Alarm in 0.5.1
Chris expressed experiencing occasional erroneous alerts trigger on a specific stream query. Ashish suggested the issue might be linked to a known duplicates bug. Uncertain, Chris decided to monitor the issue further and report if it persists.
ZincObserve Installation Issue - Email and Env variables
Jens faced issues after installing ZincObserve via Helm chart due to `ZO_ROOT_USER_EMAIL` and `ZO_ROOT_USER_PASSWORD` not set. Prabhat suggested trying the latest dev container and changing to a simpler password. The issue was resolved after changing the email which didn't match the regex validation.
ZincSearch vs Kibana and OpenObserve Improvements
Gaby is looking to move away from ElasticSearch, but finds OpenObserve lacks features he needs. Prabhat and Kirtan discuss potential improvements and consider user feedback valuable.
Understanding and Integrating with OpenObserve
刘希晨 sought clarification on the difference between ZincSearch, ZincObserve, and OpenObserve. Prabhat responded and actively engaged in a long discussion regarding an integration for 刘希晨's microservice framework. Hengfei shared that the issue 刘希晨 faced with traces upload was acknowledged and fixed.
Issue with Alerts on Metric "testing" not Triggering
Mark encountered an issue with alert creation on "testing" metric, and Ashish identified a bug, which was fixed in the released version v0.4.2.