shinesolutions/puppet-aem-curator

AEM 63 compaction not working different oak version

Closed this issue · 3 comments

mbloch1986 commented

In AEM 6.3 the compaction job is not working, as the OAK version seems to be changed.

Error Message:
[root@ip-10-0-12-94 ~]# /opt/shinesolutions/aem-tools/offline-compaction.sh /opt/aem/publish/crx-quickstart Compaction Started: Mon May 21 10:54:13 AEST 2018 Apache Jackrabbit Oak 1.4.15 10:54:13.579 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid index entry offset in tar file data00006a.tar 10:54:13.585 [main] WARN o.a.j.o.p.segment.file.TarReader - Could not find a valid tar index in /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, recovering read-only 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry data00006a.tar.brf in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry data00006a.tar.gph in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 563712 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 563712 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 563712 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 563712 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 563712 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 563712 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 563712 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.597 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564224 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.598 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 564736 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry 뛈���Ef���.�� in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565248 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry �ך�y� in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565760 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.599 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565760 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565760 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565760 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565760 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565760 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 565760 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 566272 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 566272 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 566272 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 566272 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 566272 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 566272 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid entry checksum at offset 566272 in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.600 [main] WARN o.a.j.o.p.segment.file.TarReader - Unexpected entry in tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00006a.tar, skipping... 10:54:13.623 [main] WARN o.a.j.o.p.segment.file.TarReader - Invalid index entry offset in tar file data00005a.tar Failed to open tar file /opt/aem/publish/crx-quickstart/repository/segmentstore/data00005a.tar

mbloch1986 commented

The Oak Version with the default AEM 6.3 installation as given from http://localhost:4503/crx/de/index.jsp is 1.6.6:

Repository Information

Apache Jackrabbit Oak 1.6.6 by The Apache Software Foundation
mbloch1986 commented

Once the version is changed to 1.6.6 offline-compaction is working again:

[root@ip-10-0-12-59 aem-tools]# ./offline-compac

tion.sh
/opt/aem/publish/crx-quickstart Compaction Started: Tue May 22 10:46:14 AEST 2018
Apache Jackrabbit Oak 1.6.6
Checkpoints /opt/aem/publish/crx-quickstart/repository/segmentstore

  • ae3500cd-638d-4528-82cd-69ab00534c7e created 2018-05-22 10:45:59.335 expires 2021-02-15 11:45:59.335

  • 8827593a-6fe8-432e-a021-5b743d06d3c2 created 2018-05-22 10:45:59.394 expires 2021-02-15 11:45:59.394
    Found 2 checkpoints
    Apache Jackrabbit Oak 1.6.6
    Checkpoints /opt/aem/publish/crx-quickstart/repository/segmentstore
    Referenced checkpoint from /:async@async is 8827593a-6fe8-432e-a021-5b743d06d3c2
    Referenced checkpoint from /:async@fulltext-async is ae3500cd-638d-4528-82cd-69ab00534c7e
    Removed 0 checkpoints in 41ms.
    Apache Jackrabbit Oak 1.6.6
    Compacting /opt/aem/publish/crx-quickstart/repository/segmentstore
    With default access mode
    before
    Wed May 09 22:22:16 AEST 2018, data00000a.tar
    Tue May 22 10:46:06 AEST 2018, data00004a.tar
    Wed May 09 22:20:03 AEST 2018, repo.lock
    Wed May 09 22:29:15 AEST 2018, data00001a.tar
    Wed May 09 22:30:51 AEST 2018, data00002a.tar
    Wed May 09 22:46:32 AEST 2018, data00003a.tar
    Tue May 22 10:46:16 AEST 2018, manifest
    Tue May 22 10:46:00 AEST 2018, journal.log
    size 175.7 MB (175725554 bytes)
    -> compacting
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    channel 3: open failed: connect failed: Connection refused
    -> cleaning up
    -> writing new journal.log: c6b879d2-c517-484b-afce-7d5c6456e303:4418 root 1526949986555

    after
    Wed May 09 22:20:03 AEST 2018, repo.lock
    Tue May 22 10:46:26 AEST 2018, data00005a.tar
    Tue May 22 10:46:26 AEST 2018, gc.log
    Tue May 22 10:46:26 AEST 2018, manifest
    Tue May 22 10:46:26 AEST 2018, journal.log
    size 87.7 MB (87672465 bytes)
    removed files [data00000a.tar, data00001a.tar, data00004a.tar, data00002a.tar, data00003a.tar]
    added files [data00005a.tar, gc.log]
    Compaction succeeded in 7.368 s (7s).
    /opt/aem/publish/crx-quickstart Compaction Ended: Tue May 22 10:46:26 AEST 2018

mbloch1986 commented

Introduced with release 2.2.0