Netdata Docker container error loading shared library libprotobuf.so.24, after upgrading from 1.26 to 1.28

Question

Netdata Docker container error loading shared library libprotobuf.so.24, after upgrading from 1.26 to 1.28

Closed this issue 4 years ago · 5 comments

Bug report summary

Hi thanks for the lib! When using the helmchart, I see the following problem. Thus the netdata cannot be started...

Error loading shared library libprotobuf.so.24: No such file or directory (needed by /usr/sbin/netdata)
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal24ComputeUnknownFieldsSizeERKNS1_16InternalMetadataEmPNS1_10CachedSizeE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal13OnShutdownRunEPFvPKvES3_: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf5Arena17OnArenaAllocationEPKSt9type_infom: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf5Arena19CallDestructorHooksEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal17AssignDescriptorsEPKNS1_15DescriptorTableEb: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal18EpsCopyInputStream12DoneFallbackEPKci: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10VerifyUTF8ENS0_11StringPieceEPKc: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal16ReadSizeFallbackEPKcj: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal12ExtensionSet17RegisterExtensionEPKNS0_11MessageLiteEihbb: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal9ArenaImplD1Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal9ArenaImpl28AllocateAlignedAndAddCleanupEmPFvPvE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10WireFormat37InternalSerializeUnknownFieldsToArrayERKNS0_15UnknownFieldSetEPhPNS0_2io19EpsCopyOutputStreamE: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf11MessageLite17SerializeToStringEPNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal17UnknownFieldParseEmPNS0_15UnknownFieldSetEPKcPNS1_12ParseContextE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf11StringPiece18LogFatalSizeTooBigEmPKc: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal20RepeatedPtrFieldBase7ReserveEi: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal14WireFormatLite16VerifyUtf8StringEPKciNS2_9OperationES4_: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal15ReadTagFallbackEPKcj: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf8internal9ArenaImpl14SpaceAllocatedEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal13ReflectionOps5MergeERKNS0_7MessageEPS3_: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal11InitSCCImplEPNS1_11SCCInfoBaseE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal13VerifyVersionEiiPKc: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf15UnknownFieldSet9MergeFromERKS1_: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal11LogFinisheraSERNS1_10LogMessageE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf2io19EpsCopyOutputStream30WriteStringMaybeAliasedOutlineEjRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEPh: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf5Arena21AllocateAlignedNoHookEm: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf15UnknownFieldSet13ClearFallbackEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf2io19EpsCopyOutputStream19EnsureSpaceFallbackEPh: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10LogMessageC1ENS0_8LogLevelEPKci: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf23ShutdownProtobufLibraryEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal20RepeatedPtrFieldBase14InternalExtendEi: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10LogMessagelsEPKc: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal14AddDescriptorsEPKNS1_15DescriptorTableE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10LogMessageD1Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal9ArenaImpl4InitEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal24InlineGreedyStringParserEPNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEPKcPNS1_12ParseContextE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal17VarintParseSlow64EPKcj: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf12FieldOptions16default_instanceEv: symbol not found
Error relocating /usr/sbin/netdata: descriptor_table_google_2fprotobuf_2fdescriptor_2eproto: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal26fixed_address_empty_stringB5cxx11E: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal14DestroyMessageEPKv: symbol not found
Error relocating /usr/sbin/netdata: _ZTVN6google8protobuf11MessageLiteE: symbol not found
Error relocating /usr/sbin/netdata: _ZN6google8protobuf15UnknownFieldSet16default_instanceEv: symbol not found
Error relocating /usr/sbin/netdata: _ZTVN6google8protobuf7MessageE: symbol not found

OS / Environment

kubernetes environment on CentOS.

Netdata version

1.28.0

Component Name

N/A

Steps To Reproduce

run the helmchart
see the problem

Expected behavior

no error

Answer 1 · 2021-02-02T12:26:24.000Z

Same issue for me with: netdata/netdata:v1.28.0

Previous version is okay: netdata/netdata:v1.28.0.226.latest

Both instances use docker-compose

# docker-compose version
docker-compose version 1.27.4, build 40524192
docker-py version: 4.3.1
CPython version: 3.7.7
OpenSSL version: OpenSSL 1.1.0l  10 Sep 2019

Attaching to netdata
netdata    | Creating docker group 1000
netdata    | Assign netdata user to docker group 1000
netdata    | Error loading shared library libprotobuf.so.24: No such file or directory (needed by /usr/sbin/netdata)
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal24ComputeUnknownFieldsSizeERKNS1_16InternalMetadataEmPNS1_10CachedSizeE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal13OnShutdownRunEPFvPKvES3_: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf5Arena17OnArenaAllocationEPKSt9type_infom: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf5Arena19CallDestructorHooksEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal17AssignDescriptorsEPKNS1_15DescriptorTableEb: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal18EpsCopyInputStream12DoneFallbackEPKci: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10VerifyUTF8ENS0_11StringPieceEPKc: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal16ReadSizeFallbackEPKcj: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal12ExtensionSet17RegisterExtensionEPKNS0_11MessageLiteEihbb: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal9ArenaImplD1Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal9ArenaImpl28AllocateAlignedAndAddCleanupEmPFvPvE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10WireFormat37InternalSerializeUnknownFieldsToArrayERKNS0_15UnknownFieldSetEPhPNS0_2io19EpsCopyOutputStreamE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf11MessageLite17SerializeToStringEPNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal17UnknownFieldParseEmPNS0_15UnknownFieldSetEPKcPNS1_12ParseContextE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf11StringPiece18LogFatalSizeTooBigEmPKc: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal20RepeatedPtrFieldBase7ReserveEi: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal14WireFormatLite16VerifyUtf8StringEPKciNS2_9OperationES4_: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal15ReadTagFallbackEPKcj: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf8internal9ArenaImpl14SpaceAllocatedEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal13ReflectionOps5MergeERKNS0_7MessageEPS3_: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal11InitSCCImplEPNS1_11SCCInfoBaseE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal13VerifyVersionEiiPKc: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf15UnknownFieldSet9MergeFromERKS1_: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal11LogFinisheraSERNS1_10LogMessageE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf2io19EpsCopyOutputStream30WriteStringMaybeAliasedOutlineEjRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEPh: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf5Arena21AllocateAlignedNoHookEm: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf15UnknownFieldSet13ClearFallbackEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf2io19EpsCopyOutputStream19EnsureSpaceFallbackEPh: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10LogMessageC1ENS0_8LogLevelEPKci: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf23ShutdownProtobufLibraryEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal20RepeatedPtrFieldBase14InternalExtendEi: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10LogMessagelsEPKc: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal14AddDescriptorsEPKNS1_15DescriptorTableE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal10LogMessageD1Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal9ArenaImpl4InitEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal24InlineGreedyStringParserEPNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEPKcPNS1_12ParseContextE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal17VarintParseSlow64EPKcj: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf12FieldOptions16default_instanceEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: descriptor_table_google_2fprotobuf_2fdescriptor_2eproto: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message11GetTypeNameB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message25InitializationErrorStringB5cxx11Ev: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message21CheckTypeAndMergeFromERKNS0_11MessageLiteE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf7Message20DiscardUnknownFieldsEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZNK6google8protobuf7Message13SpaceUsedLongEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZTIN6google8protobuf7MessageE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal26fixed_address_empty_stringB5cxx11E: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf8internal14DestroyMessageEPKv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZTVN6google8protobuf11MessageLiteE: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZN6google8protobuf15UnknownFieldSet16default_instanceEv: symbol not found
netdata    | Error relocating /usr/sbin/netdata: _ZTVN6google8protobuf7MessageE: symbol not found

[SNIPPED 20+ repeats of the same]

netdata exited with code 127

Answer 2 · 2021-02-02T12:37:13.000Z

This appears to be a combination of two bugs, one in our handling of Docker tags (just now fixed in #10584), and another that happened somewhere in the build process.

I’m currently working on root-causing the issue in the build process, and once that’s resolved we will be updating the v1.28 stable images to reflect the actual v1.28 release instead of the latest master that they currently are based on, as well as replacing the current nightly image with a working build.

Answer 3 · 2021-02-02T12:57:26.000Z

As a workaround, I was able to get netdata running by switching docker tag from v1.28.0 to v1.28.0.226.latest.

Answer 4 · 2021-02-02T13:41:12.000Z

We’re now pointing people at this forum topic https://community.netdata.cloud/t/today-docker-image-not-working/861 for any futher updates.

This issue will be closed out only once we’ve finished restoring the v1.28.0 and stable tags to the correct images, all other updates will be posted in the aforementioned forum topic.

Answer 5 · 2021-02-02T14:05:59.000Z

The v1.28.0 and stable tags should now be fixed.