OTel Metrics Setup - 404 Error and Authentication Issues
TLDR Ioannis encountered a 404 error and asked for assistance. Prabhat confirmed a bug, which was later fixed by Patel. Assen also found discrepancies in the documentation, which Prabhat corrected.
Ioannis
Thu, 08 Jun 2023 19:25:32 UTCfor reference the setup is
Ioannis
Thu, 08 Jun 2023 19:26:00 UTC```exporters:
prometheusremotewrite:
endpoint:
Ioannis
Thu, 08 Jun 2023 19:26:15 UTCreplacing sensitive values ofc :slightly_smiling_face:
Ioannis
Thu, 08 Jun 2023 19:54:05 UTCin all actual honesty..
Hengfei
Fri, 09 Jun 2023 00:35:07 UTCThanks you for report this, we will quick fix it
Ioannis
Fri, 09 Jun 2023 06:29:58 UTCHengfei no worries. I guess I can try the container in the meantime? Also, who can answer some questions about pricing?
Hengfei
Fri, 09 Jun 2023 06:45:47 UTCPrabhat Let you answer the questions about pricing
Prabhat
Fri, 09 Jun 2023 06:47:24 UTC> in all actual honesty..
Ioannis
Fri, 09 Jun 2023 06:47:41 UTCsure
Assen
Sun, 11 Jun 2023 13:33:47 UTCI am also trying to make this work.
Prabhat
Sun, 11 Jun 2023 13:41:12 UTCAssen You may have an @ or : symbol possibly in the token. Try regenerating the token.
Assen
Sun, 11 Jun 2023 13:41:53 UTCmy user name is my email address, so yes, there's an @
Prabhat
Sun, 11 Jun 2023 13:42:07 UTCyeah, apart from that
Prabhat
Sun, 11 Jun 2023 13:43:06 UTCAre you using one of the code examples for opentelemetry from
Prabhat
Sun, 11 Jun 2023 13:43:56 UTCActually you should not have any no-numeric characters in ingestion token
Prabhat
Sun, 11 Jun 2023 13:44:08 UTCwe made sure of that when generating the token
Prabhat
Sun, 11 Jun 2023 13:44:20 UTCunless it's not working well 100% of the time
Assen
Sun, 11 Jun 2023 13:50:17 UTCThanks! I am configuring an OTLP collector - no code - but your link helped. it brought me to
Assen
Sun, 11 Jun 2023 13:50:50 UTCI am trying to send metrics, no traces BTW
Assen
Sun, 11 Jun 2023 13:52:24 UTC```exporters:
prometheusremotewrite:
endpoint: "
Prabhat
Sun, 11 Jun 2023 13:53:07 UTCis this working?
Assen
Sun, 11 Jun 2023 13:54:12 UTCno, ``` "error": "Permanent error: Permanent error: remote write returned HTTP status 401 Unauthorized; err = %!w(<nil>): {\"Error\":\"Authentication failed - invalid token: token contains an invalid number of segments\"}"```
Prabhat
Sun, 11 Jun 2023 13:55:00 UTCLet me check in my config
Prabhat
Sun, 11 Jun 2023 14:10:40 UTCI can confirm that we have a problem. The URL and config are correct, but its not working due to a bug. The problem is only in cloud deployment. Open source version works well. Will fix it soon.
Prabhat
Sun, 11 Jun 2023 14:11:14 UTCWill confirm it here once fixed.
Assen
Sun, 11 Jun 2023 14:13:20 UTCThanks for checking!
Patel
Sun, 11 Jun 2023 14:49:20 UTCAssen Can you please check now? it should work now
Assen
Sun, 11 Jun 2023 17:53:43 UTCthat was amazingly fast! Thanks a lot Patel!
Assen
Sun, 11 Jun 2023 18:29:59 UTCIt works for me, but it would be useful to change
Prabhat
Sun, 11 Jun 2023 19:15:45 UTCThanks for pointing the issue. Fixed it.
OpenObserve
Indexed 419 threads
OpenObserve is an open-source, petabyte-scale observability platform for the cloud native realm, offering a 10x cost reduction and 140x less storage use compared to competitors like Elasticsearch or Splunk. Built in Rust for exceptional performance, it offers comprehensive features like logs, metrics, traces, dashboards, and more | Knowledge Base powered by Struct.AI
View in App
Ioannis
Thu, 08 Jun 2023 19:24:28 UTCHey folks. I followed the guide on how to setup OTel for metrics, but I am getting a 404 each time the exporter hits the endpoint - any idea why?