logstash-plugins/logstash-input-file

Unexpected end of ZLIB input stream logstash 7.9.0

pkvel01 opened this issue · 0 comments

  1. Logstash version (e.g. bin/logstash --version) logstash 7.9.0
  2. Logstash installation source (e.g. built from source, with a package manager: DEB/RPM, expanded from tar or zip archive, docker) , installed using rpm
  3. How is Logstash being run (e.g. as a service/service manager: systemd, upstart, etc. Via command line, docker/kubernetes): systemd

JVM (e.g. java -version):

If the affected version of Logstash is 7.9 (or earlier), or if it is NOT using the bundled JDK or using the 'no-jdk' version in 7.10 (or higher), please provide the following information:

  1. JVM version (java -version) java version "1.8.0_111"
    Java(TM) SE Runtime Environment (build 1.8.0_111-b14)
    Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixed mode)

  2. JVM installation source (e.g. from the Operating System's package manager, from source, etc).

  3. Value of the JAVA_HOME environment variable if set.

OS version (uname -a if on a Unix-like system): CentOS Linux release 7.5.1804 (Core)

Description of the problem including expected versus actual behavior:
logstash.conf
input {
file {
type => "gzip"
path => "/var/app/logfile/logfile.log.*.gz"
mode => "read"
check_archive_validity => "true"

filter {
}
output {
elasticsearch {
hosts => "hostname"
index => "logstash-app-%{+YYYY.MM.dd}"

     }

}

logs:
[2021-07-01T14:24:39,251][INFO ][filewatch.observingread ] START, creating Discoverer, Watch with file and sincedb collections
[2021-07-01T14:24:44,074][ERROR][logstash.javapipeline ] A plugin had an unrecoverable error. Will restart this plugin.
Pipeline_id: xxxx-app
Plugin: <LogStash::Inputs::File mode=>"read", path=>["/var/app/logfile.log.*.gz"], check_archive_validity=>true, id=>"3088a66656b0fb689bb9761a0b2bc29182ef5df41bb2b90bc6648fa8e96389bb", type=>"gzip", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_09cb82b9-2d3c-4674-a5ac-9f57847f5850", enable_metric=>true, charset=>"UTF-8">, stat_interval=>1.0, discover_interval=>15, sincedb_write_interval=>15.0, start_position=>"end", delimiter=>"\n", close_older=>3600.0, file_completed_action=>"delete", sincedb_clean_after=>1209600.0, file_chunk_size=>32768, file_chunk_count=>140737488355327, file_sort_by=>"last_modified", file_sort_direction=>"asc", exit_after_read=>false>
Error: Unexpected end of ZLIB input stream
Exception: Java::JavaIo::EOFException
Stack: java.util.zip.InflaterInputStream.fill(java/util/zip/InflaterInputStream.java:240)
java.util.zip.InflaterInputStream.read(java/util/zip/InflaterInputStream.java:158)
java.util.zip.GZIPInputStream.read(java/util/zip/GZIPInputStream.java:117)