Beat exporter need support `filebeat.inputs - type: log`; but not the deprecated `filebeat.prospectors: - input_type: log`
Closed this issue · 2 comments
duhang commented
beat-exporter/collector/filebeat.go
Line 30 in 67af338
Basically, just need replace "prospector" with "input" at the above line.
Please note that filebeat.prospectors is now deprecated and people should start using filebeat.inputs in their filebeat.yml instead.
Deprecated:
filebeat.prospectors:
- input_type: log
New:
filebeat.inputs:
- type: log
paths:
- /var/log/*.log
- /var/log/*/*.log
- /var/log/*/*/*.log
- /var/log/*/*/*/*.log
Here is what curl http://localhost:5066/stats
will show for filebeat.input
from FB 6.4.1
"filebeat": {
"events": {
"active": 11,
"added": 497,
"done": 486
},
"harvester": {
"closed": 0,
"open_files": 6,
"running": 6,
"skipped": 0,
"started": 6
},
"input": {
"log": {
"files": {
"renamed": 0,
"truncated": 0
}
}
}
}
shivas commented
@duhang thanks, i'll check it out, maybe you could grab whole json output of /stats endpoint and attach it to this issue?
duhang commented
Here you go!
# curl localhost:5066
{"beat":"filebeat","hostname":"logging-1001","name":"logging-1001","uuid":"9c15ca6e-17b5-4e2d-b068-822b6f8db768","version":"6.4.1"}
# curl localhost:5066/stats
{"beat":{"cpu":{"system":{"ticks":50,"time":{"ms":53}},"total":{"ticks":140,"time":{"ms":143},"value":140},"user":{"ticks":90,"time":{"ms":90}}},"info":{"ephemeral_id":"646ba668-0c93-45ba-91cf-e6c0398136d3","uptime":{"ms":11200}},"memstats":{"gc_next":4352240,"memory_alloc":2803896,"memory_total":8912144,"rss":29347840}},"filebeat":{"events":{"active":12,"added":165,"done":153},"harvester":{"closed":0,"open_files":4,"running":4,"skipped":0,"started":4},"input":{"log":{"files":{"renamed":0,"truncated":0}}}},"libbeat":{"config":{"module":{"running":0,"starts":0,"stops":0},"reloads":0},"output":{"events":{"acked":135,"active":0,"batches":11,"dropped":0,"duplicates":0,"failed":0,"total":135},"read":{"bytes":39064,"errors":0},"type":"elasticsearch","write":{"bytes":90225,"errors":0}},"pipeline":{"clients":1,"events":{"active":12,"dropped":0,"failed":0,"filtered":18,"published":147,"retry":17,"total":165},"queue":{"acked":135}}},"registrar":{"states":{"cleanup":0,"current":14,"update":153},"writes":{"fail":0,"success":27,"total":27}},"system":{"cpu":{"cores":32},"load":{"1":0.12,"15":0.22,"5":0.2,"norm":{"1":0.0038,"15":0.0069,"5":0.0063}}}}