Fixing openobserve with rust tracing and opentelemetry-otlp issue

TLDR Gunnar had problems with openobserve using rust tracing and opentelemetry-otlp. Ashish and West provided solutions to resolve the issue and discussed matter related to gRPC and HTTP.

Photo of Gunnar
Gunnar
Fri, 08 Sep 2023 09:02:48 UTC

Hi all, Has anyone gotten openobserve with rust tracing and opentelemetry-otlp working? I am trying to grpc to the openobserve endpoint for traces. But it is not working. I expect that the endpoint is not a grpc endpoint. Is this true?

Photo of Ashish
Ashish
Fri, 08 Sep 2023 09:03:18 UTC

Hi Gunnar

Photo of Ashish
Ashish
Fri, 08 Sep 2023 09:03:50 UTC

are you trying open observe cloud ?

Photo of Ashish
Ashish
Fri, 08 Sep 2023 09:04:04 UTC

or its on premise deployment

Photo of Gunnar
Gunnar
Fri, 08 Sep 2023 09:42:05 UTC

Hi Ashish, Thanks for your response :) Its a local container

Photo of Gunnar
Gunnar
Fri, 08 Sep 2023 09:42:45 UTC

It was easier to copy the docker command to run openobserve

Photo of Gunnar
Gunnar
Fri, 08 Sep 2023 09:57:36 UTC

```OpenTelemetry trace error occurred. Exporter otlp encountered the following error(s): the grpc server returns error (Unknown error): , detailed error message: h2 protocol error: http2 error: connection error detected: frame with invalid size```

Photo of Ashish
Ashish
Fri, 08 Sep 2023 10:07:03 UTC

can we have quick call?

Photo of Gunnar
Gunnar
Fri, 08 Sep 2023 10:44:54 UTC

Are you available monday? What time suits you? I am in the gmt+1 timezone

Photo of Ashish
Ashish
Fri, 08 Sep 2023 10:45:26 UTC

sure…lets connect on Monday

Photo of Ashish
Ashish
Fri, 08 Sep 2023 10:46:11 UTC

I am in gmt+5:30 tz

Photo of Ashish
Ashish
Fri, 08 Sep 2023 10:46:30 UTC

please message me whenever you are free

Photo of West
West
Sat, 09 Sep 2023 16:50:19 UTC

I configured using these two properties and it is working for me ZO_TRACING_ENABLED: "true" OTEL_OTLP_HTTP_ENDPOINT: ""

Photo of Ashish
Ashish
Mon, 11 Sep 2023 02:41:58 UTC

Let us know if further help is needed

Photo of Gunnar
Gunnar
Mon, 11 Sep 2023 08:06:53 UTC

He, I was going to message you but I figure it out. Is there any advantage to using the HTTP endpoint vs gRPC? gRPC should be more performant and allow more throughput.

Photo of Gunnar
Gunnar
Mon, 11 Sep 2023 08:07:51 UTC

Thanks Ashish for the help :slightly_smiling_face: and offer to give me a call and help me resolve my issue!

Photo of Ashish
Ashish
Mon, 11 Sep 2023 08:30:30 UTC

Gunnar yes grpc should be more performant , we are working on making grpc available for logs metrics & traces in upcoming release

Photo of Ashish
Ashish
Mon, 11 Sep 2023 08:31:26 UTC

as of today you can use traces with grpc for your on-prem deployment

Photo of Ashish
Ashish
Mon, 11 Sep 2023 08:31:46 UTC

I can help you with configuration details for same

Photo of Gunnar
Gunnar
Mon, 11 Sep 2023 08:33:16 UTC

Thanks, you guys are building something awesome. Looking forward to metrics and logs on gRPC :slightly_smiling_face: