Pushing Logs to S3 and Installing ZincObserve with Helm Chart

TLDR sparrow inquired about pushing logs to S3 and installing ZincObserve using a Helm chart. Hengfei provided assistance and documentation, and Prabhat confirmed the availability of the Helm chart for S3.

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:29:20 UTC

Hello Team, I was exploring the product and able to install and and use it properly but I can’t find any way around by which i can push my logs to s3 bucket using fluent bit could you please help me

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:31:15 UTC

you can follow this document to use s3

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:39:43 UTC

Yes i’ve gone through this doc, but where exactly i have to mention in fluent-bit so that it will select s3 as a storage type, because by default it is setting up as disk storage

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:40:37 UTC

as you can see all index is using disk as a storage

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:41:21 UTC

oh sorry, you use zincSearch for logs?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:41:49 UTC

zincSearch has some problems for support s3. we suggest use zincObserve for logs.

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:42:18 UTC

do we have any helm chart for zincObserve?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:42:20 UTC

there is some introduce for the difference between zincSearch and zincObserve

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:42:35 UTC

Prabhat are we ready for helm?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:43:03 UTC

i think we are working for helm, should be ready this week.

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:43:54 UTC

If not helm then how I can install zincObserve?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:44:41 UTC

single node, right?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:45:08 UTC

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:45:14 UTC

you can use k8s deploy

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:46:11 UTC

Okay got it, Thanks. Do zincObserve also use telemetry to fetch data?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:47:26 UTC

Yep, you can use `ZO_TELEMETRY=false` to disable it

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:48:03 UTC

just report some usage for us to analytics how many user. no private data.

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:48:25 UTC

you also can disable it.

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:49:00 UTC

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:49:10 UTC

there is a quick start video.

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:49:36 UTC

but i can see it’s fetching `querystring, match`

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:50:29 UTC

In our logs there so many data, we can’t just let this to be available for others

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:50:50 UTC

this is zincSearch, it report this, because we have old api & new api, we want to know if we should delete old api.

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:51:13 UTC

Yes of course, you can disable it with the environment.

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:51:26 UTC

after you disable it, it will report nothing.

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:52:14 UTC

but in our production account we have blocked all the outbounds rules, in this case it would fail

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:55:10 UTC

i didnot get your point. which will fail? you already disable it.

Photo of sparrow
sparrow
Thu, 23 Feb 2023 07:56:06 UTC

is there anyway by which I can confirm the telemetry is disabled or not?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:57:16 UTC

we provider an environment for disable it. if you want to confirm that, you can disconnect internet, itf it still report something, you will see network error.

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 07:57:37 UTC

you can try this with keep enable it. you will see the error.

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:03:21 UTC

After installing zincObserve from where sould i get the credential to login?

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:05:12 UTC

Also I’m not able to exec into the zincobserve pod neither with sh nor with bash

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:06:26 UTC

for production image, no, we use micro image. if you want login into the container, you can dev image.

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:06:36 UTC

where sould i get the credential to login?

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:06:54 UTC

you can see the deployment, it set the root user.

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:07:08 UTC

and in the document, it also mentioned the user name & password.

Photo of Prabhat
Prabhat
Thu, 23 Feb 2023 08:12:56 UTC

Helm chart should be ready this week

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:22:42 UTC

What is this error?

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:31:10 UTC

Hengfei

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:31:53 UTC

i have no idea, haven’t met this

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:32:53 UTC

Have you ingest some data?

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:32:58 UTC

yes

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:33:18 UTC

How

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:33:23 UTC

at first i was able to see the logs, but suddenly getting this error

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:33:34 UTC

Using fluent-bit

Photo of sparrow
sparrow
Thu, 23 Feb 2023 08:34:01 UTC

You can see

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:41:49 UTC

Yep

Photo of Hengfei
Hengfei
Thu, 23 Feb 2023 08:43:59 UTC

can you give some logs about the error in container for zincobserve

Photo of Prabhat
Prabhat
Thu, 23 Feb 2023 21:39:02 UTC

helm charts for s3 is now available -

Photo of sparrow
sparrow
Fri, 24 Feb 2023 08:26:45 UTC

Hello Hengfei I’ve a update on the above error

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:28:27 UTC

Which error? maybe i didn’t get it.

Photo of sparrow
sparrow
Fri, 24 Feb 2023 08:28:42 UTC

The above one that i reported

Photo of sparrow
sparrow
Fri, 24 Feb 2023 08:28:55 UTC

Photo of sparrow
sparrow
Fri, 24 Feb 2023 08:28:57 UTC

this one

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:29:14 UTC

Okay, if you have more logs about it on the server side?

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:29:29 UTC

i am not sure the problem.

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:30:16 UTC

how do you install zincobserve and the configure variables.

Photo of sparrow
sparrow
Fri, 24 Feb 2023 08:30:58 UTC

Actually i’m getting this error when I’m trying to run some query and it’s not returning anything

Photo of sparrow
sparrow
Fri, 24 Feb 2023 08:32:05 UTC

I used this manifest ```apiVersion: v1 kind: Service metadata: name: zincobserve spec: clusterIP: None selector: app: zincobserve ports: - name: http port: 5080 targetPort: 5080 --- # create statefulset apiVersion: apps/v1 kind: StatefulSet metadata: name: zincobserve labels: name: zincobserve spec: serviceName: zincobserve replicas: 1 selector: matchLabels: name: zincobserve app: zincobserve template: metadata: labels: name: zincobserve app: zincobserve spec: securityContext: fsGroup: 2000 runAsUser: 10000 runAsGroup: 3000 runAsNonRoot: true # terminationGracePeriodSeconds: 0 containers: - name: zincobserve image: public.ecr.aws/zinclabs/zincobserve:latest env: - name: ZO_ROOT_USER_EMAIL value: - name: ZO_ROOT_USER_PASSWORD value: Complexpass#123 - name: ZO_DATA_DIR value: /data - name: ZO_TELEMETRY value: "false" - name: ZO_S3_SERVER_URL value: default - name: ZO_S3_REGION_NAME value: - name: ZO_S3_ACCESS_KEY value: - name: ZO_S3_SECRET_KEY value: - name: ZO_S3_BUCKET_NAME value: # command: ["/bin/bash", "-c", "while true; do sleep 1; done"] imagePullPolicy: Always resources: limits: cpu: 1000m memory: 2048Mi requests: cpu: 256m memory: 50Mi ports: - containerPort: 5080 name: http volumeMounts: - name: data mountPath: /data volumeClaimTemplates: - metadata: name: data spec: accessModes: - ReadWriteOnce # storageClassName: default # NOTE: You can increase the storage size resources: requests: storage: 10Gi```

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:34:49 UTC

okay, can you give some errors in the container

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:35:01 UTC

to check what happens with zincobserve

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:35:09 UTC

can you send me the logs of the container

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:39:05 UTC

Or, can you delete the deploy and try again, to see it there still have this error, if you can reproduce the error, it will be better.

Photo of Hengfei
Hengfei
Fri, 24 Feb 2023 08:43:11 UTC

let’s talk in private. i will ping you.