#openobserve-cloud

Kinesis Error With OpenObserve Cloud: Invalid Response

TLDR Asher reported Kinesis errors with OpenObserve Cloud's responses. Prabhat identified the issue and promised to fix it soon.

Powered by Struct AI

1

15
1mo
Solved
Join the chat
Nov 01, 2023 (1 month ago)
Asher
Photo of md5-409106bf56669c171b90f81c7aca893e
Asher
05:08 PM
Hey all, for whatever reason in Kinesis, OpenObserve Cloud is sometimes returning an incorrect response according to Kinesis anyway. Any ideas?

Kinesis error code: HttpEndpoint.InvalidResponseFromDestination

The response received from the endpoint is invalid. See Troubleshooting HTTP Endpoints in the Firehose documentation for more information. Reason:. Response for request REDACTED_REQUEST_NO is not recognized as valid JSON or has unexpected fields. Raw response received: 200 {"code":200,"status":[{"name":"default","successful":37,"failed":0}]}
Prabhat
Photo of md5-23052f31f8f3c4b1bb3297fbc3a2aec5
Prabhat
05:09 PM
What version are you using?
05:10
Prabhat
05:10 PM
oh sorry
Asher
Photo of md5-409106bf56669c171b90f81c7aca893e
Asher
05:10 PM
Cloud
Prabhat
Photo of md5-23052f31f8f3c4b1bb3297fbc3a2aec5
Prabhat
05:10 PM
it cloud
05:10
Prabhat
05:10 PM
its a bit weird considering that OpenObserve accepted all logs
05:10
Prabhat
05:10 PM
however correct response was not provided
05:11
Prabhat
05:11 PM
which means that firehose will resend data
05:11
Prabhat
05:11 PM
give me couple min
Asher
Photo of md5-409106bf56669c171b90f81c7aca893e
Asher
05:13 PM
No rush, especially if you say will resend. Must be something in OO's response then 🙂
Prabhat
Photo of md5-23052f31f8f3c4b1bb3297fbc3a2aec5
Prabhat
05:14 PM
We will need to solve this problem since you will now have duplicate logs in OpenObserve, since OpenObserve will keep accepting every time firehose sends logs
Asher
Photo of md5-409106bf56669c171b90f81c7aca893e
Asher
05:16 PM
Good thing it's testing infrastructure still :)
Prabhat
Photo of md5-23052f31f8f3c4b1bb3297fbc3a2aec5
Prabhat
05:22 PM
okay, this might take a bit. How about I message you back when I have found the issue and solution.
05:56
Prabhat
05:56 PM
Found the issue - https://github.com/openobserve/openobserve/issues/1831 . Will fix it soon.

1

Asher
Photo of md5-409106bf56669c171b90f81c7aca893e
Asher
09:09 PM
Thanks!!

OpenObserve

OpenObserve is an open-source, petabyte-scale observability platform for the cloud native realm, offering a 10x cost reduction and 140x less storage use compared to competitors like Elasticsearch or Splunk. Built in Rust for exceptional performance, it offers comprehensive features like logs, metrics, traces, dashboards, and more | Knowledge Base powered by Struct.AI

Indexed 404 threads (74% resolved)

Join Our Community