netdata/helmchart

Prometheus not shown in netdata dashboard

fzyzcjy opened this issue ยท 26 comments

Hi thanks for the updated feature of promethus scraping! However when I view the dashboard, I do not see anything related to it :/

  1. cat /etc/netdata/go.d/sd/go.d.yml
- module: prometheus
  name: prometheus-default_tom-redis-custom-code-sentinel-1_metrics_tcp_9121
  url: http://172.18.0.8:9121/metrics
  update_every: 10
  max_time_series: 1000

- module: prometheus
  name: prometheus-default_tom-redis-custom-code-sentinel-2_metrics_tcp_9121
  url: http://172.18.0.14:9121/metrics
  update_every: 10
  max_time_series: 1000

- module: prometheus
  name: prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121
  url: http://172.18.0.16:9121/metrics
  update_every: 10
  max_time_series: 1000

- module: prometheus
  name: prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121
  url: http://172.18.0.15:9121/metrics
  update_every: 10
  max_time_series: 1000

- module: prometheus
  name: prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121
  url: http://172.18.0.17:9121/metrics
  update_every: 10
  max_time_series: 1000

- module: prometheus
  name: prometheus-kube-system_kube-controller-manager-minikube_kube-controller-manager
  url: http://172.17.0.3:10252/metrics
  update_every: 10
  max_time_series: 2000

- module: coredns
  name: coredns-kube-system_coredns-66bff467f8-xxbrq_coredns_tcp_9153
  url: http://172.18.0.2:9153/metrics

- module: prometheus
  name: prometheus-kube-system_kube-scheduler-minikube_kube-scheduler
  url: http://172.17.0.3:10251/metrics
  update_every: 10
  max_time_series: 1000
  1. cd /usr/libexec/netdata/plugins.d then ./go.d.plugin -d -c /etc/netdata/go.d/sd/go.d.yml -m prometheus (Thanks to @ilyam8 's suggestion #137 (comment))
[ INFO  ] main[main] plugin.go:106 instance is started
[ INFO  ] main[main] setup.go:39 loading config file
[ INFO  ] main[main] setup.go:47 looking for 'go.d.conf' in [/etc/netdata/go.d/sd/go.d.yml]
[ INFO  ] main[main] setup.go:54 found '/etc/netdata/go.d/sd/go.d.yml/go.d.conf
[ WARN  ] main[main] setup.go:58 couldn't load config '/etc/netdata/go.d/sd/go.d.yml/go.d.conf': open /etc/netdata/go.d/sd/go.d.yml/go.d.conf: not a directory, will use defaults
[ INFO  ] main[main] plugin.go:110 using config: enabled 'true', default_run 'true', max_procs '0'
[ INFO  ] main[main] setup.go:66 loading modules
[ INFO  ] main[main] setup.go:85 enabled/registered modules: 1/45
[ INFO  ] main[main] setup.go:90 building discovery config
[ INFO  ] main[main] setup.go:116 looking for 'prometheus.conf' in [/etc/netdata/go.d/sd/go.d.yml]
[ INFO  ] main[main] setup.go:123 found '/etc/netdata/go.d/sd/go.d.yml/prometheus.conf
[ INFO  ] main[main] setup.go:128 dummy/read/watch paths: 0/1/1
[ INFO  ] discovery[manager] manager.go:90 registered discoverers: [file discovery: [file reader file watcher]]
[ INFO  ] discovery[manager] manager.go:95 instance is started
[ INFO  ] build[manager] build.go:106 instance is started
[ INFO  ] run[manager] run.go:30 instance is started
[ INFO  ] discovery[file manager] discovery.go:71 instance is started
[ INFO  ] discovery[file watcher] watch.go:50 instance is started
[ INFO  ] discovery[file reader] read.go:39 instance is started
[ INFO  ] discovery[file reader] read.go:40 instance is stopped
[ DEBUG ] run[manager] run.go:41 tick 0
[ DEBUG ] run[manager] run.go:41 tick 1
[ WARN  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-1_metrics_tcp_9121] collect_gauge_counter.go:41 error on adding dim to chart 'redis_exporter_last_scrape_error' : unacceptable symbol in dim ID 'redis_exporter_last_scrape_error|err=dial redis: unknown network redis' : ' '
[ DEBUG ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-1_metrics_tcp_9121] collect.go:50 time series: 50, metrics: 46, charts: 47
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-1_metrics_tcp_9121] job.go:152 check success
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-1_metrics_tcp_9121] job.go:172 started, data collection interval 10s
[ WARN  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-2_metrics_tcp_9121] collect_gauge_counter.go:41 error on adding dim to chart 'redis_exporter_last_scrape_error' : unacceptable symbol in dim ID 'redis_exporter_last_scrape_error|err=dial redis: unknown network redis' : ' '
[ DEBUG ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-2_metrics_tcp_9121] collect.go:50 time series: 50, metrics: 46, charts: 47
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-2_metrics_tcp_9121] job.go:152 check success
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-2_metrics_tcp_9121] job.go:172 started, data collection interval 10s
[ WARN  ] prometheus[prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121] collect_gauge_counter.go:41 error on adding dim to chart 'redis_instance_info' : unacceptable symbol in dim ID 'redis_instance_info|maxmemory_policy=noeviction,os=Linux 4.19.76-linuxkit x86_64,redis_build_id=d94905fbc62c2ef2,redis_mode=standalone,redis_version=5.0.8,role=master' : ' '
[ DEBUG ] prometheus[prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121] collect.go:50 time series: 200, metrics: 146, charts: 147
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121] job.go:152 check success
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121] job.go:172 started, data collection interval 10s
[ WARN  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121] collect_gauge_counter.go:41 error on adding dim to chart 'redis_exporter_last_scrape_error' : unacceptable symbol in dim ID 'redis_exporter_last_scrape_error|err=dial redis: unknown network redis' : ' '
[ DEBUG ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121] collect.go:50 time series: 50, metrics: 46, charts: 47
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121] job.go:152 check success
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121] job.go:172 started, data collection interval 10s
[ WARN  ] prometheus[prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121] collect_gauge_counter.go:41 error on adding dim to chart 'redis_instance_info' : unacceptable symbol in dim ID 'redis_instance_info|maxmemory_policy=noeviction,os=Linux 4.19.76-linuxkit x86_64,redis_build_id=d94905fbc62c2ef2,redis_mode=standalone,redis_version=5.0.8,role=slave' : ' '
[ DEBUG ] prometheus[prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121] collect.go:50 time series: 208, metrics: 150, charts: 151
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121] job.go:152 check success
[ INFO  ] prometheus[prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121] job.go:172 started, data collection interval 10s
[ DEBUG ] run[manager] run.go:41 tick 2
[ DEBUG ] prometheus[prometheus-kube-system_kube-controller-manager-minikube_kube-controller-manager] collect.go:50 time series: 1599, metrics: 113, charts: 120
[ INFO  ] prometheus[prometheus-kube-system_kube-controller-manager-minikube_kube-controller-manager] job.go:152 check success
[ INFO  ] prometheus[prometheus-kube-system_kube-controller-manager-minikube_kube-controller-manager] job.go:172 started, data collection interval 10s
[ WARN  ] prometheus[prometheus-kube-system_kube-scheduler-minikube_kube-scheduler] collect.go:25 endpoint 'http://172.17.0.3:10251/metrics' returned 1083 time series, limit is 1000
[ ERROR ] prometheus[prometheus-kube-system_kube-scheduler-minikube_kube-scheduler] job.go:149 check failed
[ INFO  ] build[manager] build.go:252 module 'prometheus' job 'prometheus-kube-system_kube-scheduler-minikube_kube-scheduler' detection failed, will retry in 0 seconds
[ WARN  ] prometheus[prometheus-kube-system_kube-scheduler-minikube_kube-scheduler] collect.go:25 endpoint 'http://172.17.0.3:10251/metrics' returned 1083 time series, limit is 1000
[ ERROR ] prometheus[prometheus-kube-system_kube-scheduler-minikube_kube-scheduler] job.go:149 check failed
[ DEBUG ] run[manager] run.go:41 tick 3
[ DEBUG ] run[manager] run.go:41 tick 4
[ DEBUG ] run[manager] run.go:41 tick 5

... a lot of things such as: ...

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_exporter_build_info' 8999851
SET 'redis_exporter_build_info|build_date=2020-08-18-01:07:46,commit_sha=bac1cfead5cdb77dbce3ad567c9786f11424cf02,golang_version=go1.14.7,version=v1.10.0' = 1000
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_exporter_last_scrape_connect_time_seconds' 8999851
SET 'redis_exporter_last_scrape_connect_time_seconds' = 11
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_exporter_last_scrape_duration_seconds' 8999851
SET 'redis_exporter_last_scrape_duration_seconds' = 20
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_exporter_last_scrape_error' 8999851
SET 'redis_exporter_last_scrape_error|err=' = 0
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_exporter_scrape_duration_seconds_count' 8999851
SET 'redis_exporter_scrape_duration_seconds_count' = 70000
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_exporter_scrape_duration_seconds_sum' 8999851
SET 'redis_exporter_scrape_duration_seconds_sum' = 2854
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_exporter_scrapes_total' 8999851
SET 'redis_exporter_scrapes_total' = 70000
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_instance_info'
END

BEGIN 'prometheus_prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121.redis_keyspace_hits_total' 8999851
SET 'redis_keyspace_hits_total' = 0
END
  1. dashboard

I do see two sections for each redis instance. But IMHO they are nothing but the two containers in my redis pod (one container is redis and another is metric container. But I do not see any promethus metrics :(

image
image

Hi @fzyzcjy, yes these are pods. And it is a section per pod, so if you have many it is hard to navigate/find something (known problem).

Prometheus jobs, if they are up and running, should be below the pods. Name should start with prometheus...

Like

prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121


Well, we see that 8 endpoints were discovered (data in /etc/netdata/go.d/sd/go.d.yml). We see they are valid and those enpoints are accessible because you get data in the debug mode.


If there are no prometheus... section on the dashboard at all then something is wrong and we need to check error.log.

Example:

kubectl logs netdata-parent-68dd7f5479-shl28 | grep "go.d"

@ilyam8 Thanks very much! I will have a try very soon.

image

@ilyam8 Oh I see that section! (Not sure whether in yesterday'x experiment it exist or not). But there is no data yet. The logs are as follows:

child (related to "prometheus":

2020-10-01 23:52:22: go.d WARNING: prometheus[prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121] error on adding dim to chart 'redis_instance_info' : unacceptable symbol in dim ID 'redis_instance_info|maxmemory_policy=noeviction,os=Linux 4.19.76-linuxkit x86_64,redis_build_id=d94905fbc62c2ef2,redis_mode=standalone,redis_version=5.0.8,role=master' : ' '
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121] check success
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-default_tom-redis-custom-code-main-0_metrics_tcp_9121] started, data collection interval 10s
2020-10-01 23:52:22: go.d WARNING: prometheus[prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121] error on adding dim to chart 'redis_exporter_last_scrape_error' : unacceptable symbol in dim ID 'redis_exporter_last_scrape_error|err=dial redis: unknown network redis' : ' '
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121] check success
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-default_tom-redis-custom-code-sentinel-0_metrics_tcp_9121] started, data collection interval 10s
2020-10-01 23:52:22: go.d INFO: coredns[coredns-kube-system_coredns-66bff467f8-xxbrq_coredns_tcp_9153] check success
2020-10-01 23:52:22: go.d INFO: coredns[coredns-kube-system_coredns-66bff467f8-xxbrq_coredns_tcp_9153] started, data collection interval 1s
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-kube-system_kube-scheduler-minikube_kube-scheduler] check success
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-kube-system_kube-scheduler-minikube_kube-scheduler] started, data collection interval 10s
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-kube-system_kube-controller-manager-minikube_kube-controller-manager] check success
2020-10-01 23:52:22: go.d INFO: prometheus[prometheus-kube-system_kube-controller-manager-minikube_kube-controller-manager] started, data collection interval 10s
2020-10-01 23:52:26: go.d WARNING: prometheus[prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121] error on adding dim to chart 'redis_instance_info' : unacceptable symbol in dim ID 'redis_instance_info|maxmemory_policy=noeviction,os=Linux 4.19.76-linuxkit x86_64,redis_build_id=d94905fbc62c2ef2,redis_mode=standalone,redis_version=5.0.8,role=slave' : ' '
2020-10-01 23:52:26: go.d INFO: prometheus[prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121] check success
2020-10-01 23:52:26: go.d INFO: prometheus[prometheus-default_tom-redis-custom-code-main-1_metrics_tcp_9121] started, data collection interval 10

parent -

2020-10-01 23:52:28: netdata INFO  : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/main.db.
2020-10-01 23:52:28: netdata INFO  : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/series.db.
2020-10-01 23:52:28: netdata INFO  : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/metrics.db.
2020-10-01 23:52:28: netdata INFO  : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/charts.db.
2020-10-01 23:52:28: netdata INFO  : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.apiserver_audit_event_total/main.db.
2020-10-01 23:52:28: netdata INFO  : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.apiserver_audit_event_total/apiserver_audit_event_total.db

Full log of netdata parent -

``` Netdata entrypoint script starting 2020-10-01 23:52:12: netdata INFO : MAIN : CONFIG: cannot load cloud config '/var/lib/netdata/cloud.d/cloud.conf'. Running with internal defaults. 2020-10-01 23:52:12: netdata INFO : MAIN : Found 0 legacy dbengines, setting multidb diskspace to 256MB 2020-10-01 23:52:12: netdata INFO : MAIN : Created file '/var/lib/netdata/dbengine_multihost_size' to store the computed value 2020-10-01 23:52:12: netdata ERROR : MAIN : Ignoring host prefix '/host': path '/host' failed to stat() (errno 2, No such file or directory) 2020-10-01 23:52:12: netdata INFO : MAIN : SIGNAL: Enabling reaper 2020-10-01 23:52:12: netdata INFO : MAIN : process tracking enabled. 2020-10-01 23:52:12: netdata ERROR : MAIN : LISTENER: Invalid listen port 0 given. Defaulting to 19999. (errno 22, Invalid argument) 2020-10-01 23:52:12: netdata INFO : MAIN : resources control: allowed file descriptors: soft = 1048576, max = 1048576 2020-10-01 23:52:12: netdata INFO : MAIN : Out-Of-Memory (OOM) score is already set to the wanted value 1000 2020-10-01 23:52:12: netdata ERROR : MAIN : Cannot adjust netdata scheduling policy to idle (5), with priority 0. Falling back to nice. (errno 38, Function not implemented) 2020-10-01 23:52:12: netdata ERROR : MAIN : Cannot get my current process scheduling policy. (errno 38, Function not implemented) 2020-10-01 23:52:12: netdata INFO : MAIN : netdata started on pid 1. 2020-10-01 23:52:12: netdata INFO : MAIN : Initializing spawn client. 2020-10-01 23:52:12: netdata INFO : MAIN : Executing /usr/libexec/netdata/plugins.d/system-info.sh Spawn server is up. 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_CONTAINER_OS_NAME=Alpine Linux 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_CONTAINER_OS_ID=alpine 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_CONTAINER_OS_ID_LIKE=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_CONTAINER_OS_VERSION=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_CONTAINER_OS_VERSION_ID=3.12.0 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_CONTAINER_OS_DETECTION=/etc/os-release 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_HOST_OS_NAME=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_HOST_OS_ID=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_HOST_OS_ID_LIKE=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_HOST_OS_VERSION=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_HOST_OS_VERSION_ID=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_HOST_OS_DETECTION=unknown 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_KERNEL_NAME=Linux 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_KERNEL_VERSION=4.19.76-linuxkit 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_ARCHITECTURE=x86_64 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_VIRTUALIZATION=hypervisor 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_VIRT_DETECTION=/proc/cpuinfo 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_CONTAINER=docker 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_CONTAINER_DETECTION=dockerenv 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_CPU_LOGICAL_CPU_COUNT=12 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_CPU_VENDOR=GenuineIntel 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_CPU_MODEL=Intel(R) Core(TM) i7-8700B CPU @ 3.20GHz 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_CPU_FREQ=3200000000 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_CPU_DETECTION=lscpu 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_TOTAL_RAM=25223348224 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_RAM_DETECTION=procfs 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_TOTAL_DISK_SIZE=63999836160 2020-10-01 23:52:13: netdata INFO : MAIN : NETDATA_SYSTEM_DISK_DETECTION=sysfs 2020-10-01 23:52:13: netdata INFO : MAIN : Configuring locking mechanism for global GUID map 2020-10-01 23:52:13: netdata INFO : MAIN : Cannot open the file /var/lib/netdata/health.silencers.json, so Netdata will work with the default health configuration. 2020-10-01 23:52:13: netdata ERROR : MAIN : HEALTH [netdata-parent-566d6fcbc9-xt68s]: cannot open health file: /var/lib/netdata/health/health-log.db.old (errno 2, No such file or directory) 2020-10-01 23:52:13: netdata ERROR : MAIN : HEALTH [netdata-parent-566d6fcbc9-xt68s]: cannot open health file: /var/lib/netdata/health/health-log.db (errno 2, No such file or directory) 2020-10-01 23:52:13: netdata INFO : MAIN : Added 20bc6748-0441-11eb-a50d-0242ac12000a to global map for host netdata-parent-566d6fcbc9-xt68s 2020-10-01 23:52:13: netdata INFO : MAIN : Host 'netdata-parent-566d6fcbc9-xt68s' (at registry as 'netdata-parent-566d6fcbc9-xt68s') with guid '20bc6748-0441-11eb-a50d-0242ac12000a' initialized, os 'linux', timezone 'UTC', tags '', program_name 'netdata', program_version 'v1.25.0', update every 1, memory mode dbengine, history entries 3996, streaming disabled (to '' with api key ''), health enabled, cache_dir '/var/cache/netdata', varlib_dir '/var/lib/netdata', health_log '/var/lib/netdata/health/health-log.db', alarms default handler '/usr/libexec/netdata/plugins.d/alarm-notify.sh', alarms default recipient 'root' 2020-10-01 23:52:13: netdata INFO : MAIN : Found 0 files in path /var/cache/netdata/dbengine 2020-10-01 23:52:13: netdata INFO : MAIN : Data files not found, creating in path "/var/cache/netdata/dbengine". 2020-10-01 23:52:13: netdata INFO : MAIN : Creating new data and journal files in path /var/cache/netdata/dbengine 2020-10-01 23:52:13: netdata INFO : MAIN : Created data file "/var/cache/netdata/dbengine/datafile-1-0000000001.ndf". 2020-10-01 23:52:13: netdata INFO : MAIN : Created journal file "/var/cache/netdata/dbengine/journalfile-1-0000000001.njf". 2020-10-01 23:52:13: netdata INFO : MAIN : Found 2 files in path /var/cache/netdata/dbengine 2020-10-01 23:52:13: netdata INFO : MAIN : Scanning file "/var/cache/netdata/dbengine/datafile-1-0000000001.ndf" 2020-10-01 23:52:13: netdata INFO : MAIN : Scanning file "/var/cache/netdata/dbengine/journalfile-1-0000000001.njf" 2020-10-01 23:52:13: netdata INFO : MAIN : Metadata log files not found, creating in path "/var/cache/netdata/dbengine". 2020-10-01 23:52:13: netdata INFO : MAIN : Creating new metadata log file in path /var/cache/netdata/dbengine 2020-10-01 23:52:13: netdata INFO : MAIN : Created metadata log file "/var/cache/netdata/dbengine/metadatalog-00000-00001.mlf". 2020-10-01 23:52:13: netdata INFO : MAIN : Unable to load '/var/lib/netdata/cloud.d/claimed_id', setting state to AGENT_UNCLAIMED 2020-10-01 23:52:13: netdata INFO : STATSD : thread created with task id 273 2020-10-01 23:52:13: netdata INFO : STATSD : set name of thread 273 to STATSD 2020-10-01 23:52:13: netdata INFO : ACLK_Main : thread created with task id 274 2020-10-01 23:52:13: netdata INFO : ACLK_Main : set name of thread 274 to ACLK_Main 2020-10-01 23:52:13: netdata INFO : BACKENDS : thread created with task id 275 2020-10-01 23:52:13: netdata INFO : BACKENDS : set name of thread 275 to BACKENDS 2020-10-01 23:52:13: netdata INFO : ACLK_Main : Waiting for netdata to be ready 2020-10-01 23:52:13: netdata INFO : BACKENDS : cleaning up... 2020-10-01 23:52:13: netdata INFO : BACKENDS : thread with task id 275 finished 2020-10-01 23:52:13: netdata INFO : EXPORTING : thread created with task id 276 2020-10-01 23:52:13: netdata INFO : PLUGINSD : thread created with task id 278 2020-10-01 23:52:13: netdata INFO : PLUGINSD : set name of thread 278 to PLUGINSD 2020-10-01 23:52:13: netdata INFO : WEB_SERVER[static1] : thread created with task id 277 2020-10-01 23:52:13: netdata INFO : WEB_SERVER[static1] : set name of thread 277 to WEB_SERVER[stat 2020-10-01 23:52:13: netdata INFO : WEB_SERVER[static1] : To use encryption it is necessary to set "ssl certificate" and "ssl key" in [web] !

2020-10-01 23:52:13: netdata INFO : MAIN : Initializing command server.
2020-10-01 23:52:13: netdata INFO : WEB_SERVER[static1] : starting worker 2
2020-10-01 23:52:13: netdata INFO : EXPORTING : set name of thread 276 to EXPORTING
2020-10-01 23:52:13: netdata INFO : WEB_SERVER[static1] : starting worker 3
2020-10-01 23:52:13: netdata INFO : EXPORTING : CONFIG: cannot load user exporting config '/etc/netdata/exporting.conf'. Will try the stock version.
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static1] : starting worker 4
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static3] : thread created with task id 282
2020-10-01 23:52:14: netdata INFO : EXPORTING : No connector instances to activate
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static3] : set name of thread 282 to WEB_SERVER[stat
2020-10-01 23:52:14: netdata INFO : EXPORTING : EXPORTING: no exporting connectors configured
2020-10-01 23:52:14: netdata INFO : EXPORTING : cleaning up...
2020-10-01 23:52:14: netdata INFO : EXPORTING : thread with task id 276 finished
2020-10-01 23:52:14: netdata INFO : HEALTH : thread created with task id 279
2020-10-01 23:52:14: netdata INFO : HEALTH : set name of thread 279 to HEALTH
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static3] : POLLFD: LISTENER: listening on 'tcp:0.0.0.0:19999'
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static1] : starting worker 5
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static1] : starting worker 6
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static5] : thread created with task id 284
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static5] : set name of thread 284 to WEB_SERVER[stat
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static1] : POLLFD: LISTENER: listening on 'tcp:0.0.0.0:19999'
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static4] : thread created with task id 283
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static5] : POLLFD: LISTENER: listening on 'tcp:0.0.0.0:19999'
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static4] : set name of thread 283 to WEB_SERVER[stat
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static6] : thread created with task id 285
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static6] : set name of thread 285 to WEB_SERVER[stat
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static2] : thread created with task id 281
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static6] : POLLFD: LISTENER: listening on 'tcp:0.0.0.0:19999'
2020-10-01 23:52:14: netdata INFO : MAIN : netdata initialization completed. Enjoy real-time performance monitoring!
2020-10-01 23:52:14: netdata INFO : MAIN : /usr/libexec/netdata/plugins.d/anonymous-statistics.sh 'START' '-' '-'
2020-10-01 23:52:14: netdata ERROR : STATSD : LISTENER: IPv6 bind() on ip '::1' port 8125, socktype 2 failed. (errno 99, Address not available)
2020-10-01 23:52:14: netdata ERROR : STATSD : LISTENER: Cannot bind to ip '::1', port 8125
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static4] : POLLFD: LISTENER: listening on 'tcp:0.0.0.0:19999'
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static2] : set name of thread 281 to WEB_SERVER[stat
2020-10-01 23:52:14: netdata INFO : WEB_SERVER[static2] : POLLFD: LISTENER: listening on 'tcp:0.0.0.0:19999'
2020-10-01 23:52:14: netdata ERROR : STATSD : LISTENER: IPv6 bind() on ip '::1' port 8125, socktype 1 failed. (errno 99, Address not available)
2020-10-01 23:52:14: netdata ERROR : STATSD : LISTENER: Cannot bind to ip '::1', port 8125
2020-10-01 23:52:14: netdata INFO : STATSD : LISTENER: Listen socket udp:127.0.0.1:8125 opened successfully.
2020-10-01 23:52:14: netdata INFO : STATSD : LISTENER: Listen socket tcp:127.0.0.1:8125 opened successfully.
2020-10-01 23:52:14: netdata INFO : STATSD_COLLECTOR[1] : thread created with task id 286
2020-10-01 23:52:14: netdata INFO : STATSD_COLLECTOR[1] : set name of thread 286 to STATSD_COLLECTO
2020-10-01 23:52:14: netdata INFO : STATSD_COLLECTOR[1] : STATSD collector thread started with taskid 286
2020-10-01 23:52:14: netdata INFO : STATSD_COLLECTOR[1] : POLLFD: LISTENER: listening on 'udp:127.0.0.1:8125'
2020-10-01 23:52:14: netdata INFO : STATSD_COLLECTOR[1] : POLLFD: LISTENER: listening on 'tcp:127.0.0.1:8125'
2020-10-01 23:52:14: netdata INFO : ACLK_Main : Waiting for Cloud to be enabled
2020-10-01 23:52:14: netdata INFO : ACLK_Main : Waiting for netdata to be claimed
2020-10-01 23:52:14: netdata INFO : ACLK_Stats : thread created with task id 291
2020-10-01 23:52:14: netdata INFO : ACLK_Stats : set name of thread 291 to ACLK_Stats
2020-10-01 23:52:22: 1: 277 '[172.18.0.1]:38730' 'CONNECTED'
2020-10-01 23:52:22: 1: 277 '[172.18.0.1]:38730' 'DISCONNECTED'
2020-10-01 23:52:22: 1: 277 '[172.18.0.1]:38730' 'DATA' (sent/all = 679/1816 bytes -63%, prep/sent/total = 0.15/0.24/0.38 ms) 200 '/api/v1/info'
2020-10-01 23:52:27: 2: 282 '[172.18.0.1]:38824' 'CONNECTED'
2020-10-01 23:52:27: 2: 282 '[172.18.0.1]:38824' 'DISCONNECTED'
2020-10-01 23:52:27: 2: 282 '[172.18.0.1]:38824' 'DATA' (sent/all = 679/1816 bytes -63%, prep/sent/total = 0.17/0.33/0.50 ms) 200 '/api/v1/info'
2020-10-01 23:52:27: netdata INFO : WEB_SERVER[static4] : clients wants to STREAM metrics.
2020-10-01 23:52:27: 3: 283 '[172.17.0.3]:59056' 'CONNECTED'
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : thread created with task id 303
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : set name of thread 303 to STREAM_RECEIVER
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : STREAM minikube [172.17.0.3]:59056: receive thread created (task id 303)
2020-10-01 23:52:27: 3: 283 '[172.17.0.3]:59056' 'DISCONNECTED'
2020-10-01 23:52:27: 3: 283 '[172.17.0.3]:59056' 'STREAM' (sent/all = 0/0 bytes -0%, prep/sent/total = 1601596347688.77/1601596347689.03/0.26 ms) 200 'key=11111111-2222-3333-4444-555555555555&hostname=minikube&registry_hostname=minikube&machine_guid=21d3ebc3-2c29-4adf-9e19-f668962efd41&update_every=1&os=linux&timezone=UTC&tags=&ver=3&NETDATA_SYSTEM_OS_NAME=unknown&NETDATA_SYSTEM_OS_ID=unknown&NETDATA_SYSTEM_OS_ID_LIKE=unknown&NETDATA_SYSTEM_OS_VERSION=unknown&NETDATA_SYSTEM_OS_VERSION_ID=unknown&NETDATA_SYSTEM_OS_DETECTION=unknown&NETDATA_SYSTEM_KERNEL_NAME=Linux&NETDATA_SYSTEM_KERNEL_VERSION=4.19.76-linuxkit&NETDATA_SYSTEM_ARCHITECTURE=x86_64&NETDATA_SYSTEM_VIRTUALIZATION=hypervisor&NETDATA_SYSTEM_VIRT_DETECTION=/proc/cpuinfo&NETDATA_SYSTEM_CONTAINER=docker&NETDATA_SYSTEM_CONTAINER_DETECTION=dockerenv&NETDATA_CONTAINER_OS_NAME=Alpine Linux&NETDATA_CONTAINER_OS_ID=alpine&NETDATA_CONTAINER_OS_ID_LIKE=unknown&NETDATA_CONTAINER_OS_VERSION=unknown&NETDATA_CONTAINER_OS_VERSION_ID=3.12.0&NETDATA_CONTAINER_OS_DETECTION=&NETDATA_SYSTEM_CPU_LOGICAL_CPU_COUNT=12&NETDATA_SYSTEM_CPU_FREQ=3200000000&NETDATA_SYSTEM_TOTAL_RAM=25223348224&NETDATA_SYSTEM_TOTAL_DISK_SIZE=63999836160&NETDATA_PROTOCOL_VERSION=1.1'
2020-10-01 23:52:27: netdata ERROR : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : HEALTH [minikube]: cannot open health file: /var/lib/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/health/health-log.db.old (errno 2, No such file or directory)
2020-10-01 23:52:27: netdata ERROR : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : HEALTH [minikube]: cannot open health file: /var/lib/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/health/health-log.db (errno 2, No such file or directory)
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Host 'minikube' (at registry as 'minikube') with guid '21d3ebc3-2c29-4adf-9e19-f668962efd41' initialized, os 'linux', timezone 'UTC', tags '', program_name 'netdata', program_version 'v1.25.0', update every 1, memory mode save, history entries 3996, streaming disabled (to '' with api key ''), health enabled, cache_dir '/var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41', varlib_dir '/var/lib/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41', health_log '/var/lib/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/health/health-log.db', alarms default handler '/usr/libexec/netdata/plugins.d/alarm-notify.sh', alarms default recipient 'root'
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : STREAM minikube [receive from [172.17.0.3]:59056]: initializing communication...
2020-10-01 23:52:27: STREAM: 303 '[172.17.0.3]:59056' 'CONNECTED' host 'minikube' api key '11111111-2222-3333-4444-555555555555' machine guid '21d3ebc3-2c29-4adf-9e19-f668962efd41'
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : STREAM minikube [receive from [172.17.0.3]:59056]: Netdata is using the stream version 3.
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Postponing health checks for 60 seconds, on host 'minikube', because it was just connected.
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : STREAM minikube [receive from [172.17.0.3]:59056]: receiving metrics...
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.web_thread3_cpu/main.db.
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.web_thread3_cpu/user.db.
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.web_thread3_cpu/system.db.
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.web_thread5_cpu/main.db.
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.web_thread5_cpu/user.db.
2020-10-01 23:52:27: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.web_thread5_cpu/system.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_request_count_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_request_count_total/request_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total/response_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_request_count_total_per_status/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_request_count_total_per_status/request_per_status_processed.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_request_count_total_per_status/request_per_status_dropped.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_no_matching_zone_dropped_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_no_matching_zone_dropped_total/no_matching_zone_dropped_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_panic_count_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_panic_count_total/panic_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_proto/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_proto/request_per_proto_udp.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_proto/request_per_proto_tcp.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_ip_family/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_ip_family/request_per_ip_family_v4.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_ip_family/request_per_ip_family_v6.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_A.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_AAAA.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_MX.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_SOA.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_CNAME.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_PTR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_TXT.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_NS.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_DS.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_DNSKEY.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_RRSIG.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_NSEC.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_NSEC3.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_IXFR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_ANY.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_requests_count_total_per_type/request_per_type_other.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_NOERROR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_FORMERR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_SERVFAIL.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_NXDOMAIN.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_NOTIMP.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_REFUSED.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_YXDOMAIN.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_YXRRSET.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_NXRRSET.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_NOTAUTH.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_NOTZONE.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADSIG.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADKEY.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADTIME.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADMODE.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADNAME.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADALG.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADTRUNC.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_BADCOOKIE.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns.dns_responses_count_total_per_rcode/response_per_rcode_other.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.execution_time_of_coredns/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.execution_time_of_coredns/time.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_request_count_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_request_count_total/request_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total/response_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_request_count_total_per_status/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_request_count_total_per_status/request_per_status_processed.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_request_count_total_per_status/request_per_status_dropped.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_no_matching_zone_dropped_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_no_matching_zone_dropped_total/no_matching_zone_dropped_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_panic_count_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_panic_count_total/panic_total.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_proto/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_proto/request_per_proto_udp.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_proto/request_per_proto_tcp.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_ip_family/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_ip_family/request_per_ip_family_v4.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_ip_family/request_per_ip_family_v6.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_A.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_AAAA.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_MX.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_SOA.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_CNAME.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_PTR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_TXT.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_NS.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_DS.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_DNSKEY.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_RRSIG.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_NSEC.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_NSEC3.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_IXFR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_ANY.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_requests_count_total_per_type/request_per_type_other.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_NOERROR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_FORMERR.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_SERVFAIL.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_NXDOMAIN.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_NOTIMP.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_REFUSED.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_YXDOMAIN.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_YXRRSET.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_NXRRSET.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_NOTAUTH.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_NOTZONE.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADSIG.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADKEY.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADTIME.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADMODE.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADNAME.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADALG.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADTRUNC.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_BADCOOKIE.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153.dns_responses_count_total_per_rcode/response_per_rcode_other.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.execution_time_of_coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/netdata.execution_time_of_coredns_coredns_kube_system_coredns_66bff467f8_xxbrq_coredns_tcp_9153/time.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/series.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/metrics.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.collect_statistics/charts.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.apiserver_audit_event_total/main.db.
2020-10-01 23:52:28: netdata INFO : STREAM_RECEIVER[minikube,[172.17.0.3]:59056] : Initializing file /var/cache/netdata/21d3ebc3-2c29-4adf-9e19-f668962efd41/prometheus_prometheus_kube_system_kube_scheduler_minikube_kube_scheduler.apiserver_audit_event_total/apiserver_audit_event_total.db.
2020-10-01 23:52:28: netdata LOG FLOOD PROTECTION too many logs (201 logs in 15 seconds, threshold is set to 200 logs in 1200 seconds). Preventing more logs from process 'netdata' for 1185 seconds.
2020-10-01 23:52:41: 4: 284 '[localhost]:51328' 'CONNECTED'
2020-10-01 23:52:41: 5: 277 '[localhost]:51326' 'CONNECTED'
2020-10-01 23:52:41: 5: 277 '[localhost]:51326' 'FILECOPY' (sent/all = 379921/1147301 bytes -67%, prep/sent/total = 1.68/45.77/47.45 ms) 200 '/static/js/2.20233c1e.chunk.js'
2020-10-01 23:52:41: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 200/271 bytes -26%, prep/sent/total = 2.03/0.25/2.27 ms) 200 '/api/v1/registry'
2020-10-01 23:52:41: 5: 277 '[localhost]:51326' 'FILECOPY' (sent/all = 255910/649633 bytes -61%, prep/sent/total = 0.23/38.23/38.46 ms) 200 '/static/js/5.975c953a.chunk.js'
2020-10-01 23:52:41: 6: 277 '[localhost]:51334' 'CONNECTED'
2020-10-01 23:52:41: 7: 283 '[localhost]:51336' 'CONNECTED'
2020-10-01 23:52:41: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 720/1921 bytes -63%, prep/sent/total = 0.41/0.19/0.60 ms) 200 '//api/v1/info'
2020-10-01 23:52:41: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 2200/19181 bytes -89%, prep/sent/total = 1.34/0.56/1.89 ms) 200 '/api/v1/charts'
2020-10-01 23:52:42: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 2200/19181 bytes -89%, prep/sent/total = 0.31/0.29/0.60 ms) 200 '/api/v1/charts'
2020-10-01 23:52:42: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 515/1538 bytes -67%, prep/sent/total = 0.25/0.21/0.46 ms) 200 '/api/v1/data'
2020-10-01 23:52:42: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 512/1525 bytes -66%, prep/sent/total = 0.19/0.23/0.43 ms) 200 '/api/v1/data'
2020-10-01 23:52:42: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 510/1519 bytes -66%, prep/sent/total = 0.24/0.23/0.46 ms) 200 '/api/v1/data'
2020-10-01 23:52:42: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 566/1656 bytes -66%, prep/sent/total = 0.24/0.34/0.59 ms) 200 '/api/v1/data'
2020-10-01 23:52:42: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 521/1540 bytes -66%, prep/sent/total = 0.18/0.18/0.35 ms) 200 '/api/v1/data'
2020-10-01 23:52:42: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 137/149 bytes -8%, prep/sent/total = 0.08/0.17/0.25 ms) 200 '//api/v1/alarms'
2020-10-01 23:52:42: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 24/4 bytes -461168601842738790400%, prep/sent/total = 0.07/0.31/0.38 ms) 200 '//api/v1/alarm_log'
2020-10-01 23:52:43: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 515/1538 bytes -67%, prep/sent/total = 0.19/0.26/0.44 ms) 200 '/api/v1/data'
2020-10-01 23:52:43: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 522/1563 bytes -67%, prep/sent/total = 0.45/0.25/0.70 ms) 200 '/api/v1/data'
2020-10-01 23:52:43: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 579/1718 bytes -66%, prep/sent/total = 0.19/0.26/0.45 ms) 200 '/api/v1/data'
2020-10-01 23:52:43: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 518/1559 bytes -67%, prep/sent/total = 0.15/0.22/0.37 ms) 200 '/api/v1/data'
2020-10-01 23:52:43: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 541/1599 bytes -66%, prep/sent/total = 0.17/0.20/0.36 ms) 200 '/api/v1/data'
2020-10-01 23:52:44: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 541/1629 bytes -67%, prep/sent/total = 0.19/0.40/0.59 ms) 200 '/api/v1/data'
2020-10-01 23:52:44: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 529/1595 bytes -67%, prep/sent/total = 0.19/0.45/0.64 ms) 200 '/api/v1/data'
2020-10-01 23:52:44: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 529/1597 bytes -67%, prep/sent/total = 0.18/0.46/0.64 ms) 200 '/api/v1/data'
2020-10-01 23:52:44: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 579/1718 bytes -66%, prep/sent/total = 0.13/0.17/0.31 ms) 200 '/api/v1/data'
2020-10-01 23:52:44: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 554/1643 bytes -66%, prep/sent/total = 0.21/0.65/0.87 ms) 200 '/api/v1/data'
2020-10-01 23:52:45: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 561/1670 bytes -66%, prep/sent/total = 0.20/0.31/0.51 ms) 200 '/api/v1/data'
2020-10-01 23:52:45: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 536/1634 bytes -67%, prep/sent/total = 0.18/0.21/0.40 ms) 200 '/api/v1/data'
2020-10-01 23:52:45: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 538/1635 bytes -67%, prep/sent/total = 0.38/0.25/0.63 ms) 200 '/api/v1/data'
2020-10-01 23:52:45: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 628/1808 bytes -65%, prep/sent/total = 0.17/0.18/0.35 ms) 200 '/api/v1/data'
2020-10-01 23:52:45: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 564/1688 bytes -67%, prep/sent/total = 0.32/0.20/0.53 ms) 200 '/api/v1/data'
2020-10-01 23:52:46: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 572/1715 bytes -67%, prep/sent/total = 0.24/0.64/0.88 ms) 200 '/api/v1/data'
2020-10-01 23:52:46: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 546/1673 bytes -67%, prep/sent/total = 0.20/0.17/0.37 ms) 200 '/api/v1/data'
2020-10-01 23:52:46: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 547/1674 bytes -67%, prep/sent/total = 0.23/0.48/0.71 ms) 200 '/api/v1/data'
2020-10-01 23:52:46: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 630/1876 bytes -66%, prep/sent/total = 0.64/0.41/1.05 ms) 200 '/api/v1/data'
2020-10-01 23:52:46: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 578/1736 bytes -67%, prep/sent/total = 0.12/0.23/0.35 ms) 200 '/api/v1/data'
2020-10-01 23:52:47: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 588/1763 bytes -67%, prep/sent/total = 0.11/0.19/0.30 ms) 200 '/api/v1/data'
2020-10-01 23:52:47: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 554/1712 bytes -68%, prep/sent/total = 0.25/0.50/0.76 ms) 200 '/api/v1/data'
2020-10-01 23:52:47: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 555/1711 bytes -68%, prep/sent/total = 0.16/0.30/0.46 ms) 200 '/api/v1/data'
2020-10-01 23:52:47: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 648/1938 bytes -67%, prep/sent/total = 0.13/0.17/0.30 ms) 200 '/api/v1/data'
2020-10-01 23:52:47: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 610/1828 bytes -67%, prep/sent/total = 0.19/0.15/0.34 ms) 200 '/api/v1/data'
2020-10-01 23:52:48: 4: 284 '[localhost]:51328' 'FILECOPY' (sent/all = 379921/1147301 bytes -67%, prep/sent/total = 0.15/33.37/33.52 ms) 200 '/static/js/2.20233c1e.chunk.js'
2020-10-01 23:52:48: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 187/248 bytes -25%, prep/sent/total = 0.15/0.26/0.41 ms) 200 '/api/v1/registry'
2020-10-01 23:52:48: 4: 284 '[localhost]:51328' 'FILECOPY' (sent/all = 255910/649633 bytes -61%, prep/sent/total = 0.10/37.20/37.30 ms) 200 '/static/js/5.975c953a.chunk.js'
2020-10-01 23:52:48: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 1014/3713 bytes -73%, prep/sent/total = 0.51/18.04/18.55 ms) 200 '//api/v1/info'
2020-10-01 23:52:48: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 63769/931034 bytes -93%, prep/sent/total = 11.62/6.79/18.41 ms) 200 '/api/v1/charts'
2020-10-01 23:52:48: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 63769/931034 bytes -93%, prep/sent/total = 9.04/6.76/15.80 ms) 200 '/api/v1/charts'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 223/477 bytes -53%, prep/sent/total = 0.10/0.38/0.48 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 223/471 bytes -53%, prep/sent/total = 0.16/0.26/0.42 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 334/639 bytes -48%, prep/sent/total = 0.25/0.37/0.62 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 413/848 bytes -51%, prep/sent/total = 0.12/0.15/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 354/652 bytes -46%, prep/sent/total = 0.10/0.14/0.24 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 354/655 bytes -46%, prep/sent/total = 0.17/0.16/0.33 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 363/714 bytes -49%, prep/sent/total = 0.11/0.16/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 345/1077 bytes -68%, prep/sent/total = 0.20/0.17/0.38 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 419/1182 bytes -65%, prep/sent/total = 0.10/0.18/0.28 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 799/2060 bytes -61%, prep/sent/total = 0.12/0.18/0.30 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 300/663 bytes -55%, prep/sent/total = 0.12/0.16/0.28 ms) 200 '/api/v1/data'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 123/126 bytes -2%, prep/sent/total = 0.13/0.15/0.28 ms) 200 '//api/v1/alarms'
2020-10-01 23:52:49: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 9384/208628 bytes -96%, prep/sent/total = 2.07/0.94/3.00 ms) 200 '//api/v1/alarm_log'
2020-10-01 23:52:51: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 310/677 bytes -54%, prep/sent/total = 0.19/0.17/0.37 ms) 200 '/api/v1/data'
2020-10-01 23:52:51: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 307/667 bytes -54%, prep/sent/total = 0.10/0.14/0.25 ms) 200 '/api/v1/data'
2020-10-01 23:52:51: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 308/650 bytes -53%, prep/sent/total = 0.38/0.22/0.59 ms) 200 '/api/v1/data'
2020-10-01 23:52:51: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 307/671 bytes -54%, prep/sent/total = 0.11/0.29/0.40 ms) 200 '/api/v1/data'
2020-10-01 23:52:51: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 311/658 bytes -53%, prep/sent/total = 0.10/0.14/0.24 ms) 200 '/api/v1/data'
2020-10-01 23:52:52: 8: 284 '[172.18.0.1]:39106' 'CONNECTED'
2020-10-01 23:52:52: 8: 284 '[172.18.0.1]:39106' 'DISCONNECTED'
2020-10-01 23:52:52: 8: 284 '[172.18.0.1]:39106' 'DATA' (sent/all = 720/1921 bytes -63%, prep/sent/total = 0.15/0.24/0.39 ms) 200 '/api/v1/info'
2020-10-01 23:52:54: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 315/670 bytes -53%, prep/sent/total = 0.10/0.15/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:52:55: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 313/666 bytes -53%, prep/sent/total = 0.16/0.16/0.33 ms) 200 '/api/v1/data'
2020-10-01 23:52:55: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 304/640 bytes -52%, prep/sent/total = 0.20/0.14/0.33 ms) 200 '/api/v1/data'
2020-10-01 23:52:55: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 298/628 bytes -53%, prep/sent/total = 0.15/0.33/0.48 ms) 200 '/api/v1/data'
2020-10-01 23:52:55: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 311/660 bytes -53%, prep/sent/total = 0.13/0.20/0.33 ms) 200 '/api/v1/data'
2020-10-01 23:52:55: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 314/672 bytes -53%, prep/sent/total = 0.11/0.18/0.29 ms) 200 '/api/v1/data'
2020-10-01 23:52:55: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 317/676 bytes -53%, prep/sent/total = 0.18/0.18/0.37 ms) 200 '/api/v1/data'
2020-10-01 23:52:56: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 310/660 bytes -53%, prep/sent/total = 0.11/0.15/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:52:56: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 313/668 bytes -53%, prep/sent/total = 0.17/0.13/0.30 ms) 200 '/api/v1/data'
2020-10-01 23:52:56: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 312/662 bytes -53%, prep/sent/total = 0.10/0.15/0.25 ms) 200 '/api/v1/data'
2020-10-01 23:52:57: 9: 282 '[172.18.0.1]:39150' 'CONNECTED'
2020-10-01 23:52:57: 9: 282 '[172.18.0.1]:39150' 'DISCONNECTED'
2020-10-01 23:52:57: 9: 282 '[172.18.0.1]:39150' 'DATA' (sent/all = 720/1921 bytes -63%, prep/sent/total = 0.27/0.39/0.65 ms) 200 '/api/v1/info'
2020-10-01 23:52:57: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 298/628 bytes -53%, prep/sent/total = 0.20/0.13/0.33 ms) 200 '/api/v1/data'
2020-10-01 23:52:57: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 304/640 bytes -52%, prep/sent/total = 0.12/0.18/0.29 ms) 200 '/api/v1/data'
2020-10-01 23:52:57: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 315/670 bytes -53%, prep/sent/total = 0.10/0.15/0.25 ms) 200 '/api/v1/data'
2020-10-01 23:52:57: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 313/666 bytes -53%, prep/sent/total = 0.19/0.50/0.69 ms) 200 '/api/v1/data'
2020-10-01 23:52:59: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 120/126 bytes -5%, prep/sent/total = 0.10/0.27/0.38 ms) 200 '//api/v1/alarms'
2020-10-01 23:52:59: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 1769/28437 bytes -94%, prep/sent/total = 0.40/0.28/0.68 ms) 200 '//api/v1/alarm_log'
2020-10-01 23:53:01: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 317/676 bytes -53%, prep/sent/total = 0.11/0.14/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 298/628 bytes -53%, prep/sent/total = 0.15/0.22/0.38 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 311/660 bytes -53%, prep/sent/total = 0.21/2.64/2.85 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 304/640 bytes -52%, prep/sent/total = 0.64/1.62/2.26 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 314/672 bytes -53%, prep/sent/total = 0.15/5.09/5.24 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 10: 281 '[localhost]:51526' 'CONNECTED'
2020-10-01 23:53:04: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 317/676 bytes -53%, prep/sent/total = 0.20/0.30/0.49 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 551/1772 bytes -69%, prep/sent/total = 0.18/0.21/0.40 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 460/907 bytes -49%, prep/sent/total = 0.14/0.13/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 463/911 bytes -49%, prep/sent/total = 0.11/0.16/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 776/2026 bytes -62%, prep/sent/total = 0.24/0.27/0.51 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 712/2049 bytes -65%, prep/sent/total = 0.79/0.84/1.63 ms) 200 '/api/v1/data'
2020-10-01 23:53:04: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.16/0.31/0.47 ms) 200 '/api/v1/data'
2020-10-01 23:53:05: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 552/1802 bytes -69%, prep/sent/total = 0.25/0.37/0.62 ms) 200 '/api/v1/data'
2020-10-01 23:53:05: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 464/917 bytes -49%, prep/sent/total = 0.22/0.28/0.50 ms) 200 '/api/v1/data'
2020-10-01 23:53:05: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 469/919 bytes -49%, prep/sent/total = 0.22/0.20/0.42 ms) 200 '/api/v1/data'
2020-10-01 23:53:05: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 795/2071 bytes -62%, prep/sent/total = 0.18/0.20/0.39 ms) 200 '/api/v1/data'
2020-10-01 23:53:05: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 726/2092 bytes -65%, prep/sent/total = 0.45/0.94/1.39 ms) 200 '/api/v1/data'
2020-10-01 23:53:05: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.13/0.29/0.42 ms) 200 '/api/v1/data'
2020-10-01 23:53:06: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 555/1832 bytes -70%, prep/sent/total = 0.22/0.64/0.86 ms) 200 '/api/v1/data'
2020-10-01 23:53:06: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 469/926 bytes -49%, prep/sent/total = 0.17/0.29/0.46 ms) 200 '/api/v1/data'
2020-10-01 23:53:06: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 472/928 bytes -49%, prep/sent/total = 0.24/0.28/0.52 ms) 200 '/api/v1/data'
2020-10-01 23:53:06: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 806/2116 bytes -62%, prep/sent/total = 0.20/0.28/0.49 ms) 200 '/api/v1/data'
2020-10-01 23:53:06: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 735/2137 bytes -66%, prep/sent/total = 0.11/0.20/0.31 ms) 200 '/api/v1/data'
2020-10-01 23:53:06: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.09/0.13/0.22 ms) 200 '/api/v1/data'
2020-10-01 23:53:07: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 568/1913 bytes -70%, prep/sent/total = 0.12/0.17/0.29 ms) 200 '/api/v1/data'
2020-10-01 23:53:07: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 473/935 bytes -49%, prep/sent/total = 0.20/0.14/0.34 ms) 200 '/api/v1/data'
2020-10-01 23:53:07: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 479/937 bytes -49%, prep/sent/total = 0.15/0.15/0.30 ms) 200 '/api/v1/data'
2020-10-01 23:53:07: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 826/2161 bytes -62%, prep/sent/total = 0.13/0.18/0.31 ms) 200 '/api/v1/data'
2020-10-01 23:53:07: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 750/2182 bytes -66%, prep/sent/total = 0.20/0.44/0.63 ms) 200 '/api/v1/data'
2020-10-01 23:53:07: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.45/0.74/1.20 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 592/1945 bytes -70%, prep/sent/total = 0.35/0.44/0.79 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 581/1960 bytes -70%, prep/sent/total = 0.86/0.30/1.16 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 479/942 bytes -49%, prep/sent/total = 0.24/0.16/0.40 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 483/944 bytes -49%, prep/sent/total = 0.24/0.40/0.64 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 843/2202 bytes -62%, prep/sent/total = 0.56/0.69/1.25 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 760/2227 bytes -66%, prep/sent/total = 0.24/0.37/0.61 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.17/0.22/0.39 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.24/0.35/0.60 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.30/0.27/0.57 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 263/545 bytes -52%, prep/sent/total = 0.17/0.15/0.31 ms) 200 '/api/v1/data'
2020-10-01 23:53:08: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 253/519 bytes -51%, prep/sent/total = 0.75/2.01/2.76 ms) 200 '/api/v1/data'
2020-10-01 23:53:09: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 123/126 bytes -2%, prep/sent/total = 0.80/0.52/1.32 ms) 200 '//api/v1/alarms'
2020-10-01 23:53:09: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 1777/28591 bytes -94%, prep/sent/total = 0.76/0.54/1.30 ms) 200 '//api/v1/alarm_log'
2020-10-01 23:53:09: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.24/0.32/0.56 ms) 200 '/api/v1/data'
2020-10-01 23:53:09: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.24/0.35/0.59 ms) 200 '/api/v1/data'
2020-10-01 23:53:09: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.44/0.54/0.98 ms) 200 '/api/v1/data'
2020-10-01 23:53:09: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 263/545 bytes -52%, prep/sent/total = 0.20/0.85/1.05 ms) 200 '/api/v1/data'
2020-10-01 23:53:09: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 253/519 bytes -51%, prep/sent/total = 0.10/0.19/0.28 ms) 200 '/api/v1/data'
2020-10-01 23:53:10: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.23/0.27/0.49 ms) 200 '/api/v1/data'
2020-10-01 23:53:10: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.10/0.15/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:53:10: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.12/0.16/0.28 ms) 200 '/api/v1/data'
2020-10-01 23:53:10: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 263/545 bytes -52%, prep/sent/total = 0.07/0.20/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:53:10: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 253/519 bytes -51%, prep/sent/total = 0.10/0.24/0.34 ms) 200 '/api/v1/data'
2020-10-01 23:53:11: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.10/0.25/0.35 ms) 200 '/api/v1/data'
2020-10-01 23:53:11: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.08/0.15/0.23 ms) 200 '/api/v1/data'
2020-10-01 23:53:11: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.08/0.17/0.25 ms) 200 '/api/v1/data'
2020-10-01 23:53:11: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 263/545 bytes -52%, prep/sent/total = 0.07/0.35/0.42 ms) 200 '/api/v1/data'
2020-10-01 23:53:11: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 253/519 bytes -51%, prep/sent/total = 0.07/0.20/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:53:12: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.08/0.24/0.32 ms) 200 '/api/v1/data'
2020-10-01 23:53:12: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.09/0.17/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:53:12: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.07/0.15/0.23 ms) 200 '/api/v1/data'
2020-10-01 23:53:12: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 263/545 bytes -52%, prep/sent/total = 0.12/0.19/0.30 ms) 200 '/api/v1/data'
2020-10-01 23:53:12: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 253/519 bytes -51%, prep/sent/total = 0.07/0.19/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:53:13: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.07/0.17/0.24 ms) 200 '/api/v1/data'
2020-10-01 23:53:13: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.12/0.14/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:53:13: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.08/0.19/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:53:13: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 263/545 bytes -52%, prep/sent/total = 0.10/0.21/0.31 ms) 200 '/api/v1/data'
2020-10-01 23:53:13: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 253/519 bytes -51%, prep/sent/total = 0.09/0.15/0.24 ms) 200 '/api/v1/data'
2020-10-01 23:53:17: 10: 281 '[localhost]:51526' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.18/0.42/0.60 ms) 200 '/api/v1/data'
2020-10-01 23:53:17: 7: 283 '[localhost]:51336' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.55/1.93/2.48 ms) 200 '/api/v1/data'
2020-10-01 23:53:17: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.17/0.67/0.85 ms) 200 '/api/v1/data'
2020-10-01 23:53:17: 6: 277 '[localhost]:51334' 'DATA' (sent/all = 263/545 bytes -52%, prep/sent/total = 0.14/0.56/0.70 ms) 200 '/api/v1/data'
2020-10-01 23:53:17: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 253/519 bytes -51%, prep/sent/total = 0.13/0.72/0.85 ms) 200 '/api/v1/data'
2020-10-01 23:53:18: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 908/2728 bytes -67%, prep/sent/total = 0.17/0.25/0.42 ms) 200 '/api/v1/data'
2020-10-01 23:53:18: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.14/0.26/0.40 ms) 200 '/api/v1/data'
2020-10-01 23:53:18: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.21/0.13/0.34 ms) 200 '/api/v1/data'
2020-10-01 23:53:18: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 533/1046 bytes -49%, prep/sent/total = 0.14/0.16/0.29 ms) 200 '/api/v1/data'
2020-10-01 23:53:19: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 538/1050 bytes -49%, prep/sent/total = 0.51/0.31/0.82 ms) 200 '/api/v1/data'
2020-10-01 23:53:19: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 987/2709 bytes -64%, prep/sent/total = 0.15/0.25/0.40 ms) 200 '/api/v1/data'
2020-10-01 23:53:19: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 262/545 bytes -52%, prep/sent/total = 0.14/0.89/1.03 ms) 200 '/api/v1/data'
2020-10-01 23:53:19: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 122/126 bytes -3%, prep/sent/total = 0.20/0.19/0.40 ms) 200 '//api/v1/alarms'
2020-10-01 23:53:19: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 1433/20114 bytes -93%, prep/sent/total = 0.42/0.21/0.62 ms) 200 '//api/v1/alarm_log'
2020-10-01 23:53:19: 4: 284 '[localhost]:51328' 'DATA' (sent/all = 255/523 bytes -51%, prep/sent/total = 0.21/0.21/0.42 ms) 200 '/api/v1/data'
2020-10-01 23:53:19: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 255/527 bytes -52%, prep/sent/total = 0.10/0.51/0.60 ms) 200 '/api/v1/data'
2020-10-01 23:53:19: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 923/2774 bytes -67%, prep/sent/total = 0.17/0.27/0.44 ms) 200 '/api/v1/data'
2020-10-01 23:53:20: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 1001/2754 bytes -64%, prep/sent/total = 0.20/0.17/0.37 ms) 200 '/api/v1/data'
2020-10-01 23:53:20: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 538/1057 bytes -49%, prep/sent/total = 0.12/0.15/0.27 ms) 200 '/api/v1/data'
2020-10-01 23:53:20: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 541/1057 bytes -49%, prep/sent/total = 0.27/0.23/0.50 ms) 200 '/api/v1/data'
2020-10-01 23:53:20: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 717/2408 bytes -70%, prep/sent/total = 0.21/0.29/0.51 ms) 200 '/api/v1/data'
2020-10-01 23:53:20: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 714/2424 bytes -71%, prep/sent/total = 0.23/0.46/0.69 ms) 200 '/api/v1/data'
2020-10-01 23:53:20: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 424/866 bytes -51%, prep/sent/total = 0.12/0.14/0.26 ms) 200 '/api/v1/data'
2020-10-01 23:53:20: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 412/849 bytes -51%, prep/sent/total = 0.12/0.15/0.28 ms) 200 '/api/v1/data'
2020-10-01 23:53:21: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 1018/2796 bytes -64%, prep/sent/total = 0.19/0.18/0.37 ms) 200 '/api/v1/data'
2020-10-01 23:53:21: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 542/1063 bytes -49%, prep/sent/total = 0.15/0.15/0.29 ms) 200 '/api/v1/data'
2020-10-01 23:53:21: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 549/1066 bytes -48%, prep/sent/total = 0.15/0.32/0.47 ms) 200 '/api/v1/data'
2020-10-01 23:53:21: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 741/2452 bytes -70%, prep/sent/total = 0.14/0.18/0.32 ms) 200 '/api/v1/data'
2020-10-01 23:53:21: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 748/2513 bytes -70%, prep/sent/total = 0.16/0.23/0.39 ms) 200 '/api/v1/data'
2020-10-01 23:53:21: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 427/875 bytes -51%, prep/sent/total = 1.60/0.18/1.78 ms) 200 '/api/v1/data'
2020-10-01 23:53:21: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 414/857 bytes -52%, prep/sent/total = 0.14/0.15/0.29 ms) 200 '/api/v1/data'
2020-10-01 23:53:22: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 1031/2845 bytes -64%, prep/sent/total = 0.14/0.17/0.31 ms) 200 '/api/v1/data'
2020-10-01 23:53:22: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 550/1073 bytes -49%, prep/sent/total = 0.15/0.24/0.40 ms) 200 '/api/v1/data'
2020-10-01 23:53:22: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 553/1078 bytes -49%, prep/sent/total = 0.14/0.21/0.35 ms) 200 '/api/v1/data'
2020-10-01 23:53:22: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 748/2496 bytes -70%, prep/sent/total = 0.23/0.25/0.48 ms) 200 '/api/v1/data'
2020-10-01 23:53:22: 11: 282 '[172.18.0.1]:39386' 'CONNECTED'
2020-10-01 23:53:22: 11: 282 '[172.18.0.1]:39386' 'DISCONNECTED'
2020-10-01 23:53:22: 11: 282 '[172.18.0.1]:39386' 'DATA' (sent/all = 720/1921 bytes -63%, prep/sent/total = 0.21/0.27/0.48 ms) 200 '/api/v1/info'
2020-10-01 23:53:22: 5: 277 '[localhost]:51326' 'DATA' (sent/all = 749/2535 bytes -70%, prep/sent/total = 0.23/0.27/0.49 ms) 200 '/api/v1/data'

</details>

Thanks very much!

There is nothing wrong in the logs. Did you wait? It is 2 update_uvery before data appears. In this case it is 20 seconds.

Yes I waited for minutes, but still see nothing :/ Thanks for your reply!

child (related to "prometheus":

lets check related go.d logs

Thanks very much! I will check it soon

Hi sorry for the late reply! I reproduced the problem, and here is the full log file, such that it can be easily grep to find out whatever is needed :)

logs-from-netdata-in-netdata-child-vk6qx.txt

Ok, i expected it

2020-10-08 14:08:43: go.d INFO: main[main] received broken pipe signal (13). Terminating..

go.d.plugin gest SIGPIPE and exit 1, i have no clue why there is SIGPIPE.

Netdata has restart a plugin feature. I changed exit code to 0.

I can create a custom netdata image with latest go.d.plugin and you test it, sounds good?

Thanks for the reply! I can test it (possibly tomorrow).

@fzyzcjy netdata/netdata#10046 is going to get merged today, so you can just try latest (netdata/netdata || netdata/netdata:latest) tomorrow.

@fzyzcjy Sounds great! So I just need to change docker image name to netdata/netdata:latest right?

Yes (dont forget to switch back to the stable image after the tests โ˜๏ธ )

@ilyam8 Get it. Thanks!

Hi, here is the log of netdata child with :latest
logs-from-netdata-in-netdata-child-pm4th.txt

Same logs (because we grep "go.d"), go.d.plugin should be restarted after

2020-10-11 06:21:35: go.d INFO: main[main] received broken pipe signal (13). Terminating...

check plugins.d logs - grep -i plugins.d ...

@ilyam8 Sorry I do not fully get it. I uploaded all logs generated by netdata child without any grepping. So what should I do?

Yes, you are right.

I see

2020-10-11 06:21:28: go.d INFO: prometheus[prometheus-default_tom-redis-bloom-main-1_metrics_tcp_9121] check success
2020-10-11 06:21:28: go.d INFO: prometheus[prometheus-default_tom-redis-bloom-main-1_metrics_tcp_9121] started, data collection interval 10s
2020-10-11 06:21:35: go.d INFO: main[main] received broken pipe signal (13). Terminating...

2020-10-11 06:21:36: 1: 169427 '[172.17.0.3]:35744' 'CONNECTED'
2020-10-11 06:21:36: 1: 169427 '[172.17.0.3]:35744' 'DISCONNECTED'
2020-10-11 06:21:36: 1: 169427 '[172.17.0.3]:35744' 'DATA' (sent/all = 672/1719 bytes -61%, prep/sent/total = 0.32/0.33/0.64 ms) 200 '/api/v1/info'
k8s_default_tom-redis-bloom-sentinel-1_04175fca-e4b7-4818-a1fb-ca4a7d889fc4_sentinel'
k8s_default_tom-redis-bloom-sentinel-1_04175fca-e4b7-4818-a1fb-ca4a7d889fc4_sentinel'
k8s_default_tom-redis-bloom-main-1_4f8d6bc1-760f-4d2b-901e-75ec71504007_redis'
k8s_default_tom-redis-bloom-main-1_4f8d6bc1-760f-4d2b-901e-75ec71504007_redis'
2020-10-11 06:21:46: 2: 169441 '[172.17.0.3]:35882' 'CONNECTED'
2020-10-11 06:21:46: 2: 169441 '[172.17.0.3]:35882' 'DISCONNECTED'
2020-10-11 06:21:46: 2: 169441 '[172.17.0.3]:35882' 'DATA' (sent/all = 672/1719 bytes -61%, prep/sent/total = 0.44/0.48/0.92 ms) 200 '/api/v1/info'
k8s_default_tom-redis-bloom-sentinel-2_2d47d1c2-f540-47a0-9dad-41ab96c7b605_sentinel'
k8s_default_tom-redis-bloom-sentinel-2_2d47d1c2-f540-47a0-9dad-41ab96c7b605_sentinel'
k8s_default_tom-redis-bloom-main-0_6fa21fb3-93aa-432e-aaa9-98bc895d8f34_redis'
k8s_default_tom-redis-bloom-main-0_6fa21fb3-93aa-432e-aaa9-98bc895d8f34_redis'
k8s_default_netdata-child-pm4th_10e1f977-dd35-4378-9844-1fde8ef38730_sd'
k8s_default_netdata-child-pm4th_10e1f977-dd35-4378-9844-1fde8ef38730_sd'
k8s_default_tom-redis-bloom-sentinel-0_5088d21d-5b6f-45f4-9ddf-4be2a17437b4_sentinel'
k8s_default_tom-redis-bloom-sentinel-0_5088d21d-5b6f-45f4-9ddf-4be2a17437b4_sentinel'
2020-10-11 06:22:06: 3: 169435 '[172.17.0.3]:36122' 'CONNECTED'
2020-10-11 06:22:06: 3: 169435 '[172.17.0.3]:36122' 'DISCONNECTED'
2020-10-11 06:22:06: 3: 169435 '[172.17.0.3]:36122' 'DATA' (sent/all = 672/1719 bytes -61%, prep/sent/total = 0.40/0.16/0.56 ms) 200 '/api/v1/info'
2020-10-11 06:22:16: 4: 169441 '[172.17.0.3]:36260' 'CONNECTED'
2020-10-11 06:22:16: 4: 169441 '[172.17.0.3]:36260' 'DISCONNECTED'
2020-10-11 06:22:16: 4: 169441 '[172.17.0.3]:36260' 'DATA' (sent/all = 672/1719 bytes -61%, prep/sent/total = 0.25/0.23/0.49 ms) 200 '/api/v1/info'
curl: (7) Couldn't connect to server

I dont understand why there is no https://github.com/netdata/netdata/blob/861a951bf4e24fdfe84110f206f9c1d9e38c9086/collectors/plugins.d/plugins_d.c#L172-L179

and why i have no connected to '/opt/netdata/usr/libexec/netdata/plugins.d/go.d.plugin' running on pid

test@deb10-ukraine:/opt/netdata/var/log/netdata$ grep -i pluginsd error.log | grep go.d
2020-10-11 07:36:20: netdata ERROR : PLUGINSD[go.d] : read failed: end of file (errno 9, Bad file descriptor)
2020-10-11 07:36:20: netdata INFO  : PLUGINSD[go.d] : PARSER ended
2020-10-11 07:36:20: netdata ERROR : PLUGINSD[go.d] : '/opt/netdata/usr/libexec/netdata/plugins.d/go.d.plugin' (pid 26832) disconnected after 0 successful data collections (ENDs).
2020-10-11 07:36:20: netdata INFO  : PLUGINSD[go.d] : '/opt/netdata/usr/libexec/netdata/plugins.d/go.d.plugin' (pid 26832) does not generate useful output but it reports success (exits with 0). Waiting a bit before starting it again..
2020-10-11 07:36:20: netdata INFO  : PLUGINSD : stopping plugin thread: plugin:go.d
2020-10-11 07:36:20: netdata INFO  : PLUGINSD[go.d] : data collection thread exiting
2020-10-11 07:36:20: netdata INFO  : PLUGINSD[go.d] : killing child process pid 26832
2020-10-11 07:36:20: netdata INFO  : PLUGINSD[go.d] : thread with task id 26820 finished
2020-10-11 07:36:21: netdata INFO  : PLUGINSD[go.d] : thread created with task id 27235
2020-10-11 07:36:21: netdata INFO  : PLUGINSD[go.d] : set name of thread 27235 to PLUGINSD[go.d]
2020-10-11 07:36:21: netdata INFO  : PLUGINSD[go.d] : connected to '/opt/netdata/usr/libexec/netdata/plugins.d/go.d.plugin' running on pid 27245
0 Downloads $ grep -i pluginsd logs-from-netdata-in-netdata-child-pm4th.txt | grep go.d
2020-10-11 06:21:21: netdata INFO  : PLUGINSD[go.d] : thread created with task id 169442
2020-10-11 06:21:21: netdata INFO  : PLUGINSD[go.d] : set name of thread 169442 to PLUGINSD[go.d]

@ilyam8 Er maybe I just re-run it again today and give another log.txt?

Yes, please do. Btw how many nodes do you have?

@ilyam8 I am experimenting it with minikube on local machine, so only 1 node. I will re-run it soon since I am busy with some tasks currently

Sorry for being late. I am busy with some frontend issues so do not touch ops for days. I run it again today, and here is the new log. I tried to grep it but still not find the log you mentioned :/ I also attached my helm chart as the zip.
netdata.zip
logs-from-netdata-in-netdata-child-kbttv (2).txt

I will do some test in our testing gke env (have no such issue in my own small gke 2 nodes cluster)

@ilyam8 Sorry for this strange issue. I will also try on another cloud-based k8s env later when I have access to it. (But IMHO there may be many minikube users since it is common to first test setups on local minikube before going to production env)

Ok, i did tests in our testing env and noticed that go.d process is not up in child nd containers.

Checked logs and found

2020-10-28 13:32:51: netdata ERROR : PLUGINSD[go.d] : requested a BEGIN on chart 'prometheus_prometheus-infra_corp-traefik-774db55c49-ss84k_corp-traefik_tcp_9000.traefik_service_request_duration_seconds_bucket|code=302,method=GET,protocol=http,service=mon-pomerium-proxy-https@kubernetes', which does not exist on host 'gke-dev-main-a2332e42-92bz'. Disabling it.

I didn't know that there is hard limit for type.id chart field. It is 200 chars.


In my case go.d create the chart but its type.id length is 205, so netdata plugins.d disables the whole plugin on the chart BEGIN.

CHART 'prometheus_prometheus-infra_corp-traefik-774db55c49-ss84k_corp-traefik_tcp_9000.traefik_service_request_duration_seconds_bucket|code=302,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '' 'How long it took to process the request on a service, partitioned by status code, protocol, and method.' 'observations' 'traefik_service' 'prometheus.traefik_service_request_duration_seconds_bucket' 'stacked' '70052' '10' '' 'go.d' 'prometheus'
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=0.1,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '0.1' 'incremental' '1' '1000' ''
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=0.3,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '0.3' 'incremental' '1' '1000' ''
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=1.2,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '1.2' 'incremental' '1' '1000' ''
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=5,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '5' 'incremental' '1' '1000' ''
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=15,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '15' 'incremental' '1' '1000' ''
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=30,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '30' 'incremental' '1' '1000' ''
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=60,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '60' 'incremental' '1' '1000' ''
DIMENSION 'traefik_service_request_duration_seconds_bucket|code=302,le=+Inf,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' '+Inf' 'incremental' '1' '1000' ''

BEGIN 'prometheus_prometheus-infra_corp-traefik-774db55c49-ss84k_corp-traefik_tcp_9000.traefik_service_request_duration_seconds_bucket|code=302,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes'
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=0.1,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 250000
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=0.3,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 2000
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=1.2,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 0
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=5,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 0
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=15,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 0
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=30,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 0
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=60,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 0
SET 'traefik_service_request_duration_seconds_bucket|code=302,le=+Inf,method=GET,protocol=http,service=mon-pomerium-authenticate-https@kubernetes' = 0