OpenObserve Errors and How to Fix Them
TLDR Ilya encountered errors while using OpenObserve. Ashish suggested using the dev image and provided instructions to clean up data. After implementing the solution, the errors were resolved.
Ashish
Fri, 09 Jun 2023 12:39:15 UTCHi Ilya..this is a bug in current release
Ashish
Fri, 09 Jun 2023 12:39:51 UTCyou can use dev image to proceed or we would make a release next week with fixes
Ashish
Fri, 09 Jun 2023 12:40:54 UTCpublic.ecr.aws/zinclabs/openobserve-dev:v0.4.7-155f766
Ashish
Fri, 09 Jun 2023 12:41:06 UTCCan you try this image
Ilya
Fri, 09 Jun 2023 12:41:17 UTCAshish gonna try rn
Ashish
Fri, 09 Jun 2023 12:41:25 UTCAlso..if possible clean up existing data
Ashish
Fri, 09 Jun 2023 12:41:34 UTCingest data & test
Ilya
Fri, 09 Jun 2023 12:44:14 UTCAshish could you please led me on how can I clean minio storage while using Helm-deployed openobserve?
Ashish
Fri, 09 Jun 2023 12:47:31 UTCdo you have MinIO Client (mc)
Ashish
Fri, 09 Jun 2023 12:48:06 UTCyou can use that to mc rm --force --recursive myminio/mybucket/*
Hengfei
Fri, 09 Jun 2023 12:48:40 UTCActually, you can use the UI delete the stream.
Ilya
Fri, 09 Jun 2023 12:48:46 UTCoh.. my bucket is empty so looks like something is misconfigured
Hengfei
Fri, 09 Jun 2023 12:48:52 UTCit will auto delete data in storage.
Ashish
Fri, 09 Jun 2023 12:49:20 UTCfrom Left Menu --> Streams
Ashish
Fri, 09 Jun 2023 12:49:28 UTCit will list call your streams
Ashish
Fri, 09 Jun 2023 12:49:42 UTCdelete the ones you want to cleanup
Ilya
Fri, 09 Jun 2023 12:51:35 UTCUpdated to aforementioned version, ingested some logs, the error now is: ```"Arrow error: Json error: failed to parse \"unknown\" as Int64"```
Ashish
Fri, 09 Jun 2023 12:55:02 UTCthis is during ingestion?
Ashish
Fri, 09 Jun 2023 12:55:25 UTCthis is single node deployment right?
Ashish
Fri, 09 Jun 2023 12:55:52 UTCin openobserv dir you should have /data/ dir
Ashish
Fri, 09 Jun 2023 12:56:01 UTCcan you please clean up that as well
Ilya
Fri, 09 Jun 2023 12:57:10 UTCthat’s helm k8s deployment with minio
Ilya
Fri, 09 Jun 2023 12:57:32 UTCthat error appears while searching logs (`/api/default/_search?type=logs`)
Ashish
Fri, 09 Jun 2023 12:59:45 UTCdelete the cluster & delete PV named like data-zo1-openobserve-ingester-0
Ashish
Fri, 09 Jun 2023 13:00:42 UTCsince your wal has corrupted data
Ashish
Fri, 09 Jun 2023 13:00:52 UTCyou are facing this issue
OpenObserve
Indexed 419 threads
OpenObserve is an open-source, petabyte-scale observability platform for the cloud native realm, offering a 10x cost reduction and 140x less storage use compared to competitors like Elasticsearch or Splunk. Built in Rust for exceptional performance, it offers comprehensive features like logs, metrics, traces, dashboards, and more | Knowledge Base powered by Struct.AI
View in App
Ilya
Fri, 09 Jun 2023 12:32:14 UTCHey guys! I just set up OpenObserve as our production logging system, and it’s pretty neat! I’m glad to see another cool Rust development. Now, I’m encountering two errors while trying to execute a SELECT * from logs query: ```"External error: Arrow error: Json error: failed to parse 18432951799850641000 as Int64"``` ```"Arrow error: Json error: expected string got false"``` It seems like something under the hood is attempting to convert our log entries to a specified schema, but the logs are not strictly typed. Is there any workaround for this issue?