Failing tests on Gentoo distro

Question

Failing tests on Gentoo distro

MocioF opened this issue a year ago · 10 comments

Describe the bug
I'm trying to write an ebuild for paho.mqtt.c for gentoo. The ebuid that is now in gentoo repo has problem running test.
I modified that ebuild and you can see a draft of a new ebuild here: https://pastebin.com/iz32macJ
The problem is that many tests doesn't pass:

58% tests passed, 63 tests failed out of 151

Total Test time (real) = 8223.76 sec

The following tests FAILED:
8 - test1-1-ws-single-thread-client (Failed)
9 - test1-2-ws-multithread-callbacks (Failed)
11 - test1-4-ws-client-persistence (Failed)
12 - test1-5-ws-disconnect-with-quiesce (Failed)
13 - test1-6-ws-connlost-will-message (Failed)
14 - test1-7-ws-connlost-binary-will-message (Failed)
22 - test15-1-ws-single-thread-client (Failed)
23 - test15-2-ws-multithread-callbacks (Subprocess aborted)
25 - test15-4-ws-client-persistence (Failed)
26 - test15-5-ws-disconnect-with-quiesce (Failed)
27 - test15-6-ws-connlost-will-message (Failed)
28 - test15-7-ws-connlost-binary-will-message (Failed)
30 - test2-1-ws-multiple-threads-single-client (Failed)
32 - test3-2as-mutual-ssl-auth-single-thread (Failed)
33 - test3-2am-mutual-ssl-auth-multi-thread (Failed)
36 - test3-2e-ssl-with-ha (Failed)
37 - test3-3as-broker-auth-server-cert-in-client-store-single-thread (Failed)
38 - test3-3am-broker-auth-server-cert-in-client-store-multi-thread (Failed)
40 - test3-4s-broker-auth-accept-invalid-certificate-single-thread (Failed)
41 - test3-4m-broker-auth-accept-invalid-certificate-multi-thread (Failed)
43 - test3-2as-ws-mutual-ssl-auth-single-thread (Failed)
44 - test3-2am-ws-mutual-ssl-auth-multi-thread (Failed)
47 - test3-2e-ws-ssl-with-ha (Failed)
48 - test3-3as-ws-broker-auth-server-cert-in-client-store-single-thread (Failed)
49 - test3-3am-ws-broker-auth-server-cert-in-client-store-multi-thread (Failed)
51 - test3-4s-ws-broker-auth-accept-invalid-certificate-single-thread (Failed)
52 - test3-4m-ws-broker-auth-accept-invalid-certificate-multi-thread (Failed)
61 - test45-1-basic-connect-subscribe-receive (Failed)
64 - test45-4-send-receive-big-messages (Failed)
71 - test5-2a-mutual-ssl-auth-certificates-in-place (Failed)
72 - test5-2a-ws-mutual-ssl-auth-certificates-in-place (Failed)
79 - test5-3a-server-auth-server-cert-in-client-store (Failed)
80 - test5-3a-ws-server-auth-server-cert-in-client-store (Failed)
83 - test5-4-accept-invalid-certificates (Failed)
84 - test5-4-ws-accept-invalid-certificates (Failed)
85 - test5-6-multiple-connections (Failed)
86 - test5-6-ws-multiple-connections (Failed)
87 - test5-7-big-messages (Failed)
88 - test5-7-ws-big-messages (Failed)
89 - test5-2e-ssl-with-ha (Failed)
90 - test5-2e-ws-ssl-with-ha (Failed)
91 - test5-5-server-verify-with-capath (Failed)
92 - test5-5-ws-server-verify-with-capath (Failed)
112 - test9-1-ws-offline-buffering-send-disconnected (Timeout)
113 - test9-2-ws-offline-buffering-send-disconnected-serverURIs (Failed)
114 - test9-3-ws-offline-buffering-auto-reconnect (Timeout)
115 - test9-4-ws-offline-buffering-auto-reconnect-serverURIs (Timeout)
116 - test9-5-ws-offline-buffering-max-buffered (Timeout)
117 - test9-6-ws-offline-buffering-max-buffered-binary-will (Timeout)
118 - test9-8-ws-offline-buffering-before-connect (Timeout)
119 - test9-10-ws-offline-buffering-delete-oldest-messages (Timeout)
126 - test95-1ws-offline-buffering-send-disconnected (Timeout)
127 - test95-2ws-offline-buffering-send-disconnected-serverURIs (Timeout)
128 - test95-3ws-offline-buffering-auto-reconnect (Timeout)
129 - test95-4ws-offline-buffering-auto-reconnect-serverURIs (Timeout)
130 - test95-5ws-offline-buffering-max-buffered (Timeout)
131 - test95-6ws-offline-buffering-max-buffered-binary-will (Timeout)
133 - test10-2-server_topic_aliases (Failed)
134 - test10-3-subscription_ids (Failed)
136 - test10-5-error_handling (Failed)
137 - test10-6-qos_1_2_errors (Failed)
142 - test11-2-server_topic_aliases (Failed)
143 - test11-3-subscription_ids (Failed)
Errors while running CTest

To Reproduce

On a gentoo installation, move to {your-local-repo}/dev-libs/paho-mqtt-c/
create the ebuild digest:
~ $ ebuild ./paho-mqtt-c-1.3.12-r1.ebuild digest
run ebuild tests
~ $ FEATURES="test" ebuild ./paho-mqtt-c-1.3.12-r1.ebuild test

** Environment (please complete the following information):**

OS: Linux
Version: 6.1.31-gentoo

Additional context
Are there some dependencies or kernel features to be checked before successfully run test?

Answer 1 · 2023-07-06T13:03:50.000Z

I don't think there's anything extra you should need - I've built and run the tests on all sorts of hardware and OSes, including Raspberry Pi, for instance.

The best way to try and diagnose is to run one of those failing tests, perhaps with the --verbose option, to see what assertions are failing. If more is needed, turn on the client library protocol tracing too. That's where I'd start.

Answer 2 · 2023-07-06T21:54:03.000Z

The problem seems to be related to connections using the ws:// protocol. This is an example of a failed test:

test 8
        Start   8: test1-1-ws-single-thread-client

8: Test command: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test1 "--test_no" "1" "--connection" "ws://localhost:1883"
8: Working Directory: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test
8: Test timeout computed to be: 540
8: 
8: Setting connection to ws://localhost:1883
8: 20230706 150048.796 Starting test 1 - single threaded client using receive
8: =========================================================
8:                    Trace Output
8: Product name: Eclipse Paho Synchronous MQTT C Client Library
8: Version: 1.3.12
8: Build level: 2023-07-06T13:00:06Z
8: /proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023
8: 
8: =========================================================
8: 20230706 150049.000 Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test1.c, line 401, description: Good rc from connect


8: 
8: rc was -120230706 150049.000 TEST1: test failed. 2 tests run, 1 failures.
8: 20230706 150049.000 verdict fail
  8/151 Test   #8: test1-1-ws-single-thread-client ......................................***Failed    0.21 sec

I noticed that all tests using "--connection" "ws://localhost:1883" fail, while tests using "--connection" "tcp://localhost:1883", or "--connection" "tcp://localhost:1883" "--proxy_connection" "tcp://localhost:1884", succeed.

This is the same test with --verbose option

$ /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test1 "--test_no" "1" "--connection" "ws://localhost:1883" "--verbose"

Setting connection to ws://localhost:1883

Setting verbose on
20230706 235111.060 Starting test 1 - single threaded client using receive
=========================================================
                   Trace Output
Product name: Eclipse Paho Synchronous MQTT C Client Library
Version: 1.3.12
Build level: 2023-07-06T14:20:47Z
/proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023

=========================================================
20230706 235111.060 Assertion succeeded, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test1.c, line 374, description: good rc from create
20230706 235111.060 Connecting
20230706 235111.264 Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test1.c, line 401, description: Good rc from connect

rc was -120230706 235111.264 TEST1: test failed. 2 tests run, 1 failures.
20230706 235111.264 verdict fail

Answer 3 · 2023-07-10T16:45:55.000Z

I thought that at first too, but while a lot of the tests in your original list are websockets, there are quite a few which aren't too.

For intance, there are:

87 - test5-7-big-messages (Failed)
88 - test5-7-ws-big-messages (Failed)

which is the same test using websockets and without.

Are there any error messages on the test broker console? We should rule out any problem on that side too.

Answer 4 · 2023-07-10T21:05:09.000Z

Thanks @icraggs
Some tests did not pass for a problem on starting test broker (i resolved calling "sleep 2" after starting the broker andafter starting the proxy).
Now I have problem with 30 tests; the test result is:

The following tests FAILED:
32 - test3-2as-mutual-ssl-auth-single-thread (Failed)
33 - test3-2am-mutual-ssl-auth-multi-thread (Failed)
36 - test3-2e-ssl-with-ha (Failed)
37 - test3-3as-broker-auth-server-cert-in-client-store-single-thread (Failed)
38 - test3-3am-broker-auth-server-cert-in-client-store-multi-thread (Failed)
43 - test3-2as-ws-mutual-ssl-auth-single-thread (Failed)
44 - test3-2am-ws-mutual-ssl-auth-multi-thread (Failed)
47 - test3-2e-ws-ssl-with-ha (Failed)
48 - test3-3as-ws-broker-auth-server-cert-in-client-store-single-thread (Failed)
49 - test3-3am-ws-broker-auth-server-cert-in-client-store-multi-thread (Failed)
58 - test4-6-ha-connections (Timeout)
66 - test45-6-ha-connections (Timeout)
71 - test5-2a-mutual-ssl-auth-certificates-in-place (Failed)
72 - test5-2a-ws-mutual-ssl-auth-certificates-in-place (Failed)
79 - test5-3a-server-auth-server-cert-in-client-store (Failed)
80 - test5-3a-ws-server-auth-server-cert-in-client-store (Failed)
85 - test5-6-multiple-connections (Failed)
86 - test5-6-ws-multiple-connections (Failed)
87 - test5-7-big-messages (Failed)
88 - test5-7-ws-big-messages (Failed)
91 - test5-5-server-verify-with-capath (Failed)
92 - test5-5-ws-server-verify-with-capath (Failed)
105 - test9-2-offline-buffering-send-disconnected-serverURIs (Failed)
107 - test9-4-offline-buffering-auto-reconnect-serverURIs (Timeout)
113 - test9-2-ws-offline-buffering-send-disconnected-serverURIs (Failed)
115 - test9-4-ws-offline-buffering-auto-reconnect-serverURIs (Timeout)
121 - test95-2-offline-buffering-send-disconnected-serverURIs (Timeout)
123 - test95-4-offline-buffering-auto-reconnect-serverURIs (Timeout)
127 - test95-2ws-offline-buffering-send-disconnected-serverURIs (Timeout)
129 - test95-4ws-offline-buffering-auto-reconnect-serverURIs (Timeout)
Errors while running CTest

I will modify the script to log the broker console output in a different file.
When starting the broker, the output is:

INFO 20230709 111838 Python version 3.11.4 (main, Jun 24 2023, 00:59:17) [GCC 12.2.1 20230428]
DEBUG 20230709 111838 Starting sharedData {}
INFO 20230709 111838 Using shared lock 139805004277952
INFO 20230709 111838 MQTT 3.1.1 Paho Test Broker
INFO 20230709 111838 Optional behaviour, publish on pubrel: False
INFO 20230709 111838 Optional behaviour, single publish on overlapping topics: True
INFO 20230709 111838 Optional behaviour, drop QoS 0 publications to disconnected clients: True
INFO 20230709 111838 Optional behaviour, support zero length clientids: True
INFO 20230709 111838 Sharing subscription data
INFO 20230709 111838 Using shared lock 139805004277952
INFO 20230709 111838 MQTT 5.0 Paho Test Broker
INFO 20230709 111838 Options {'visual': False, 'persistence': False, 'overlapping_single': True, 'dropQoS0': True, 'zero_length_clientids': True, 'publish_on_pubrel': False, 'topicAliasMaximum': 2, 'maximumPacketSize': 200000000, 'receiveMaximum': 20, 'serverKeepAlive': 60, 'maximum_qos': 2, 'retain_available': True, 'subscription_identifier_available': True, 'shared_subscription_available': True, 'server_keep_alive': None}
INFO 20230709 111838 Sharing subscription data
INFO 20230709 111838 Using shared lock 139805004277952
INFO 20230709 111838 MQTT-SN Paho Test Broker
INFO 20230709 111838 Optional behaviour, publish on pubrel: True
INFO 20230709 111838 Optional behaviour, single publish on overlapping topics: True
INFO 20230709 111838 Optional behaviour, drop QoS 0 publications to disconnected clients: True
INFO 20230709 111838 Optional behaviour, support zero length clientids: True
INFO 20230709 111838 Starting TCP listener on address '' port 1883 
INFO 20230709 111838 Starting TCP listener on address '' port 18883 
INFO 20230709 111838 Starting TCP listener on address '' port 18884 with TLS support
INFO 20230709 111838 Starting TCP listener on address '' port 18885 with TLS support
INFO 20230709 111838 Starting TCP listener on address '' port 18886 with TLS support
INFO 20230709 111838 Starting TCP listener on address '' port 18887 with TLS support
INFO 20230709 111838 Starting TCP listener on address '' port 18888

And this is the otput of failed 86, 87 and 88 tests:


test 86
        Start  86: test5-6-ws-multiple-connections

86: Test command: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test5 "--test_no" "9" "--ws" "--hostname" "localhost" "--client_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/client.pem" "--server_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/test-root-ca.crt"
86: Working Directory: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test
86: Test timeout computed to be: 540
86: 
86: Setting websockets on
86: Setting connection to wss://localhost:18883
86: Setting mutual_auth_connection to wss://localhost:18884
86: Setting nocert_mutual_auth_connection to wss://localhost:18887
86: Setting server_auth_connection to wss://localhost:18885
86: Setting anon_connection to wss://localhost:18886
86: Setting psk_connection to wss://localhost:18888
86: 20230709 114145.857 Starting test 6 - multiple connections
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
DEBUG 20230709 114145 Connection SNI info localhost
86: =========================================================
86:                    Trace Output
86: Product name: Eclipse Paho Asynchronous MQTT C Client Library
86: Version: 1.3.12
86: Build level: 2023-07-09T09:18:31Z
86: OpenSSL version: OpenSSL 1.1.1u  30 May 2023
86: OpenSSL flags: compiler: x86_64-pc-linux-gnu-gcc -fPIC -pthread -m64 -Wa,--noexecstack -march=core-avx2 -O2 -pipe -fno-strict-aliasing -Wa,--noexecstack -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DRC4_ASM -DMD5_ASM -DAESNI_ASM -DVPAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DX25519_ASM -DPOLY1305_ASM -DNDEBUG  -DOPENSSL_NO_BUF_FREELISTS
86: OpenSSL build timestamp: built on: Sat Jul  8 17:43:15 2023 UTC
86: OpenSSL platform: platform: linux-x86_64
86: OpenSSL directory: OPENSSLDIR: "/etc/ssl"
86: /proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023
86: 
86: =========================================================
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 1985, description: There should be no failures in this test. test6OnConnectFailure callback was called
86: 20230709 114146.023 failed: test test6. 40 tests run, 10 failures.
86: 20230709 114146.023 Total tests run: 40
86: 20230709 114146.023 verdict fail
 86/151 Test  #86: test5-6-ws-multiple-connections ......................................***Failed    0.17 sec
test 87
        Start  87: test5-7-big-messages

87: Test command: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test5 "--test_no" "10" "--hostname" "localhost" "--client_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/client.pem" "--server_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/test-root-ca.crt"
87: Working Directory: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test
87: Test timeout computed to be: 540
87: Setting connection to ssl://localhost:18883
87: Setting mutual_auth_connection to ssl://localhost:18884
87: Setting nocert_mutual_auth_connection to ssl://localhost:18887
87: Setting server_auth_connection to ssl://localhost:18885
87: Setting anon_connection to ssl://localhost:18886
87: Setting psk_connection to ssl://localhost:18888
87: 20230709 114146.029 Starting test 7 - big messages
DEBUG 20230709 114146 Connection SNI info localhost
DEBUG 20230709 114147 Connection SNI info localhost
87: =========================================================
87:                    Trace Output
87: Product name: Eclipse Paho Asynchronous MQTT C Client Library
87: Version: 1.3.12
87: Build level: 2023-07-09T09:18:31Z
87: OpenSSL version: OpenSSL 1.1.1u  30 May 2023
87: OpenSSL flags: compiler: x86_64-pc-linux-gnu-gcc -fPIC -pthread -m64 -Wa,--noexecstack -march=core-avx2 -O2 -pipe -fno-strict-aliasing -Wa,--noexecstack -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DRC4_ASM -DMD5_ASM -DAESNI_ASM -DVPAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DX25519_ASM -DPOLY1305_ASM -DNDEBUG  -DOPENSSL_NO_BUF_FREELISTS
87: OpenSSL build timestamp: built on: Sat Jul  8 17:43:15 2023 UTC
87: OpenSSL platform: platform: linux-x86_64
87: OpenSSL directory: OPENSSLDIR: "/etc/ssl"
87: /proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023
87: 
87: =========================================================
87: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 2108, description: There should be no failures in this test. test7OnConnectFailure callback was called
87: 20230709 114147.248 failed: test test7. 4 tests run, 1 failures.
87: 20230709 114147.248 Total tests run: 4
87: 20230709 114147.248 verdict fail
 87/151 Test  #87: test5-7-big-messages .................................................***Failed    1.22 sec
test 88
        Start  88: test5-7-ws-big-messages

88: Test command: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test5 "--test_no" "10" "--ws" "--hostname" "localhost" "--client_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/client.pem" "--server_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/test-root-ca.crt"
88: Working Directory: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test
88: Test timeout computed to be: 540
88: 
88: Setting websockets on
88: Setting connection to wss://localhost:18883
88: Setting mutual_auth_connection to wss://localhost:18884
88: Setting nocert_mutual_auth_connection to wss://localhost:18887
88: Setting server_auth_connection to wss://localhost:18885
88: Setting anon_connection to wss://localhost:18886
88: Setting psk_connection to wss://localhost:18888
88: 20230709 114147.254 Starting test 7 - big messages
DEBUG 20230709 114147 Connection SNI info localhost
DEBUG 20230709 114148 Connection SNI info localhost
88: =========================================================
88:                    Trace Output
88: Product name: Eclipse Paho Asynchronous MQTT C Client Library
88: Version: 1.3.12
88: Build level: 2023-07-09T09:18:31Z
88: OpenSSL version: OpenSSL 1.1.1u  30 May 2023
88: OpenSSL flags: compiler: x86_64-pc-linux-gnu-gcc -fPIC -pthread -m64 -Wa,--noexecstack -march=core-avx2 -O2 -pipe -fno-strict-aliasing -Wa,--noexecstack -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DRC4_ASM -DMD5_ASM -DAESNI_ASM -DVPAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DX25519_ASM -DPOLY1305_ASM -DNDEBUG  -DOPENSSL_NO_BUF_FREELISTS
88: OpenSSL build timestamp: built on: Sat Jul  8 17:43:15 2023 UTC
88: OpenSSL platform: platform: linux-x86_64
88: OpenSSL directory: OPENSSLDIR: "/etc/ssl"
88: /proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023
88: 
88: =========================================================
88: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 2108, description: There should be no failures in this test. test7OnConnectFailure callback was called
88: 20230709 114148.476 failed: test test7. 4 tests run, 1 failures.
88: 20230709 114148.476 Total tests run: 4
88: 20230709 114148.476 verdict fail
 88/151 Test  #88: test5-7-ws-big-messages ..............................................***Failed    1.23 sec

Answer 5 · 2023-07-11T12:21:13.000Z

Ok, next step is to turn on the library tracing for at least one test to see if that helps diagnose it. It seems to be a problem in connecting, and there don't seem to be any error messages on the server side.

You can turn the tracing on in an individual test program by changing:

 MQTTAsync_setTraceLevel(MQTTASYNC_TRACE_ERROR);

to

 MQTTAsync_setTraceLevel(MQTTASYNC_TRACE_MINUMUM);

at the bottom of test5.c for instance.

Answer 6 · 2023-07-12T05:57:12.000Z

test 71 seems to fail for a problem related to the certification authority signing the certificate for localhost

test 71
        Start  71: test5-2a-mutual-ssl-auth-certificates-in-place

71: Test command: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test5 "--test_no" "2" "--hostname" "localhost" "--client_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/client.pem" "--server_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/test-root-ca.crt"
71: Working Directory: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test
71: Test timeout computed to be: 540
71: Setting connection to ssl://localhost:18883
71: Setting mutual_auth_connection to ssl://localhost:18884
71: Setting nocert_mutual_auth_connection to ssl://localhost:18887
71: Setting server_auth_connection to ssl://localhost:18885
71: Setting anon_connection to ssl://localhost:18886
71: Setting psk_connection to ssl://localhost:18888
71: 20230711 155536.919 Starting test 2a - Mutual SSL authentication
71: =========================================================
71:                    Trace Output
71: Product name: Eclipse Paho Asynchronous MQTT C Client Library
71: Version: 1.3.12
71: Build level: 2023-07-11T13:32:56Z
71: OpenSSL version: OpenSSL 1.1.1u  30 May 2023
71: OpenSSL flags: compiler: x86_64-pc-linux-gnu-gcc -fPIC -pthread -m64 -Wa,--noexecstack -march=core-avx2 -O2 -pipe -fno-strict-aliasing -Wa,--noexecstack -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DRC4_ASM -DMD5_ASM -DAESNI_ASM -DVPAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DX25519_ASM -DPOLY1305_ASM -DNDEBUG  -DOPENSSL_NO_BUF_FREELISTS
71: OpenSSL build timestamp: built on: Sat Jul  8 17:43:15 2023 UTC
71: OpenSSL platform: platform: linux-x86_64
71: OpenSSL directory: OPENSSLDIR: "/etc/ssl"
71: /proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023
71: 
71: =========================================================
71: 19700101 010000.000 0 sent messages and 0 received messages restored for client test2a
71: 
71: 19700101 010000.000 0 commands restored for client test2a
71: 19700101 010000.000 0 queued messages restored for client test2a
71: 19700101 010000.000 Connecting to serverURI localhost:18884 with MQTT version 4
71: 19700101 010000.000 New socket 5 for localhost:18884, port 18884
71: 19700101 010000.000 Connect pending
71: 19700101 010000.000 m->c->connect_state = 1
71: 19700101 010000.000 SSL cipher available: 0:TLS_AES_256_GCM_SHA384
71: 19700101 010000.000 SSL cipher available: 1:TLS_CHACHA20_POLY1305_SHA256
71: 19700101 010000.000 SSL cipher available: 2:TLS_AES_128_GCM_SHA256
71: 19700101 010000.000 SSL cipher available: 3:ECDHE-ECDSA-AES256-GCM-SHA384
71: 19700101 010000.000 SSL cipher available: 4:ECDHE-RSA-AES256-GCM-SHA384
71: 19700101 010000.000 SSL cipher available: 5:DHE-RSA-AES256-GCM-SHA384
71: 19700101 010000.000 SSL cipher available: 6:ECDHE-ECDSA-CHACHA20-POLY1305
71: 19700101 010000.000 SSL cipher available: 7:ECDHE-RSA-CHACHA20-POLY1305
71: 19700101 010000.000 SSL cipher available: 8:DHE-RSA-CHACHA20-POLY1305
71: 19700101 010000.000 SSL cipher available: 9:ECDHE-ECDSA-AES128-GCM-SHA256
71: 19700101 010000.000 SSL cipher available: 10:ECDHE-RSA-AES128-GCM-SHA256
71: 19700101 010000.000 SSL cipher available: 11:DHE-RSA-AES128-GCM-SHA256
71: 20230711 155536.934 SSL cipher available: 12:ECDHE-ECDSA-AES256-SHA384
71: 20230711 155536.934 SSL cipher available: 13:ECDHE-RSA-AES256-SHA384
71: 20230711 155536.934 SSL cipher available: 14:DHE-RSA-AES256-SHA256
71: 20230711 155536.934 SSL cipher available: 15:ECDHE-ECDSA-AES128-SHA256
71: 20230711 155536.934 SSL cipher available: 16:ECDHE-RSA-AES128-SHA256
71: 20230711 155536.934 SSL cipher available: 17:DHE-RSA-AES128-SHA256
71: 20230711 155536.934 SSL cipher available: 18:ECDHE-ECDSA-AES256-SHA
71: 20230711 155536.934 SSL cipher available: 19:ECDHE-RSA-AES256-SHA
71: 20230711 155536.934 SSL cipher available: 20:DHE-RSA-AES256-SHA
71: 20230711 155536.934 SSL cipher available: 21:ECDHE-ECDSA-AES128-SHA
71: 20230711 155536.934 SSL cipher available: 22:ECDHE-RSA-AES128-SHA
71: 20230711 155536.934 SSL cipher available: 23:DHE-RSA-AES128-SHA
71: 20230711 155536.934 SSL cipher available: 24:RSA-PSK-AES256-GCM-SHA384
71: 20230711 155536.934 SSL cipher available: 25:DHE-PSK-AES256-GCM-SHA384
71: 20230711 155536.934 SSL cipher available: 26:RSA-PSK-CHACHA20-POLY1305
71: 20230711 155536.934 SSL cipher available: 27:DHE-PSK-CHACHA20-POLY1305
71: 20230711 155536.934 SSL cipher available: 28:ECDHE-PSK-CHACHA20-POLY1305
71: 20230711 155536.934 SSL cipher available: 29:AES256-GCM-SHA384
71: 20230711 155536.934 SSL cipher available: 30:PSK-AES256-GCM-SHA384
71: 20230711 155536.934 SSL cipher available: 31:PSK-CHACHA20-POLY1305
71: 20230711 155536.934 SSL cipher available: 32:RSA-PSK-AES128-GCM-SHA256
71: 20230711 155536.934 SSL cipher available: 33:DHE-PSK-AES128-GCM-SHA256
71: 20230711 155536.934 SSL cipher available: 34:AES128-GCM-SHA256
71: 20230711 155536.934 SSL cipher available: 35:PSK-AES128-GCM-SHA256
DEBUG 20230711 155536 Connection SNI info localhost
71: 20230711 155536.934 SSL cipher available: 36:AES256-SHA256
71: 20230711 155536.934 SSL cipher available: 37:AES128-SHA256
71: 20230711 155536.934 SSL cipher available: 38:ECDHE-PSK-AES256-CBC-SHA384
71: 20230711 155536.934 SSL cipher available: 39:ECDHE-PSK-AES256-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 40:SRP-RSA-AES-256-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 41:SRP-AES-256-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 42:RSA-PSK-AES256-CBC-SHA384
71: 20230711 155536.934 SSL cipher available: 43:DHE-PSK-AES256-CBC-SHA384
71: 20230711 155536.934 SSL cipher available: 44:RSA-PSK-AES256-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 45:DHE-PSK-AES256-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 46:AES256-SHA
71: 20230711 155536.934 SSL cipher available: 47:PSK-AES256-CBC-SHA384
71: 20230711 155536.934 SSL cipher available: 48:PSK-AES256-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 49:ECDHE-PSK-AES128-CBC-SHA256
71: 20230711 155536.934 SSL cipher available: 50:ECDHE-PSK-AES128-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 51:SRP-RSA-AES-128-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 52:SRP-AES-128-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 53:RSA-PSK-AES128-CBC-SHA256
71: 20230711 155536.934 SSL cipher available: 54:DHE-PSK-AES128-CBC-SHA256
71: 20230711 155536.934 SSL cipher available: 55:RSA-PSK-AES128-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 56:DHE-PSK-AES128-CBC-SHA
71: 20230711 155536.934 SSL cipher available: 57:AES128-SHA
71: 20230711 155536.934 SSL cipher available: 58:PSK-AES128-CBC-SHA256
71: 20230711 155536.934 SSL cipher available: 59:PSK-AES128-CBC-SHA
71: 20230711 155536.934 the src string is truncated
71: 20230711 155536.934 SSL handshake started write:unknown:unknown
71: 20230711 155536.934 SSL state connect:before SSL initialization:(NONE)
71: 20230711 155536.934 sent 0 256 buflen 5
71: 20230711 155536.934 sent 772 22 buflen 306
71: 20230711 155536.934 SSL state connect:SSLv3/TLS write client hello:(NONE)
71: 20230711 155536.934 SSL connect:SSLv3/TLS write client hello
71: 20230711 155536.934 SSLSocket error WANT_READ/WANT_WRITE
71: 20230711 155536.934 m->c->connect_state = 2
71: 20230711 155536.934 received 0 256 buflen 5
71: 20230711 155536.934 SSL state connect:SSLv3/TLS write client hello:(NONE)
71: 20230711 155536.934 received 772 22 buflen 69
71: 20230711 155536.936 received 0 256 buflen 5
71: 20230711 155536.936 SSL state connect:SSLv3/TLS read server hello:(NONE)
71: 20230711 155536.936 received 771 22 buflen 2880
71: 20230711 155536.936 sent 0 256 buflen 5
71: 20230711 155536.936 sent 771 21 buflen 2
71: 20230711 155536.936 SSL alert write:fatal:unknown CA
71: 20230711 155536.936 SSL connect:error
71: 20230711 155536.936 SSLSocket error (1) in SSL_connect for socket 5 rc -1 errno 0 Success
71: 
71: 20230711 155536.936 Removed socket 5
71: 20230711 155536.936 Removed socket 5
71: 20230711 155536.936 Connect failed, more to try
71: 20230711 155536.936 Could not find client corresponding to socket 5
71: 20230711 155536.936 Connecting to serverURI localhost:18884 with MQTT version 3
71: 20230711 155536.936 New socket 5 for localhost:18884, port 18884
71: 20230711 155536.936 Connect pending
71: 20230711 155536.936 m->c->connect_state = 1
71: 20230711 155536.936 SSL cipher available: 0:TLS_AES_256_GCM_SHA384
71: 20230711 155536.936 SSL cipher available: 1:TLS_CHACHA20_POLY1305_SHA256
71: 20230711 155536.936 SSL cipher available: 2:TLS_AES_128_GCM_SHA256
71: 20230711 155536.936 SSL cipher available: 3:ECDHE-ECDSA-AES256-GCM-SHA384
71: 20230711 155538.040 SSL cipher available: 4:ECDHE-RSA-AES256-GCM-SHA384
71: 20230711 155538.040 SSL cipher available: 5:DHE-RSA-AES256-GCM-SHA384
71: 20230711 155538.040 SSL cipher available: 6:ECDHE-ECDSA-CHACHA20-POLY1305
71: 20230711 155538.040 SSL cipher available: 7:ECDHE-RSA-CHACHA20-POLY1305
71: 20230711 155538.040 SSL cipher available: 8:DHE-RSA-CHACHA20-POLY1305
71: 20230711 155538.040 SSL cipher available: 9:ECDHE-ECDSA-AES128-GCM-SHA256
71: 20230711 155538.040 SSL cipher available: 10:ECDHE-RSA-AES128-GCM-SHA256
71: 20230711 155538.040 SSL cipher available: 11:DHE-RSA-AES128-GCM-SHA256
71: 20230711 155538.040 SSL cipher available: 12:ECDHE-ECDSA-AES256-SHA384
DEBUG 20230711 155538 Connection SNI info localhost
71: 20230711 155538.040 SSL cipher available: 13:ECDHE-RSA-AES256-SHA384
71: 20230711 155538.040 SSL cipher available: 14:DHE-RSA-AES256-SHA256
71: 20230711 155538.040 SSL cipher available: 15:ECDHE-ECDSA-AES128-SHA256
71: 20230711 155538.040 SSL cipher available: 16:ECDHE-RSA-AES128-SHA256
71: 20230711 155538.040 SSL cipher available: 17:DHE-RSA-AES128-SHA256
71: 20230711 155538.040 SSL cipher available: 18:ECDHE-ECDSA-AES256-SHA
71: 20230711 155538.040 SSL cipher available: 19:ECDHE-RSA-AES256-SHA
71: 20230711 155538.040 SSL cipher available: 20:DHE-RSA-AES256-SHA
71: 20230711 155538.040 SSL cipher available: 21:ECDHE-ECDSA-AES128-SHA
71: 20230711 155538.040 SSL cipher available: 22:ECDHE-RSA-AES128-SHA
71: 20230711 155538.040 SSL cipher available: 23:DHE-RSA-AES128-SHA
71: 20230711 155538.040 SSL cipher available: 24:RSA-PSK-AES256-GCM-SHA384
71: 20230711 155538.040 SSL cipher available: 25:DHE-PSK-AES256-GCM-SHA384
71: 20230711 155538.040 SSL cipher available: 26:RSA-PSK-CHACHA20-POLY1305
71: 20230711 155538.040 SSL cipher available: 27:DHE-PSK-CHACHA20-POLY1305
71: 20230711 155538.040 SSL cipher available: 28:ECDHE-PSK-CHACHA20-POLY1305
71: 20230711 155538.040 SSL cipher available: 29:AES256-GCM-SHA384
71: 20230711 155538.040 SSL cipher available: 30:PSK-AES256-GCM-SHA384
71: 20230711 155538.040 SSL cipher available: 31:PSK-CHACHA20-POLY1305
71: 20230711 155538.040 SSL cipher available: 32:RSA-PSK-AES128-GCM-SHA256
71: 20230711 155538.040 SSL cipher available: 33:DHE-PSK-AES128-GCM-SHA256
71: 20230711 155538.040 SSL cipher available: 34:AES128-GCM-SHA256
71: 20230711 155538.040 SSL cipher available: 35:PSK-AES128-GCM-SHA256
71: 20230711 155538.040 SSL cipher available: 36:AES256-SHA256
71: 20230711 155538.040 SSL cipher available: 37:AES128-SHA256
71: 20230711 155538.040 SSL cipher available: 38:ECDHE-PSK-AES256-CBC-SHA384
71: 20230711 155538.040 SSL cipher available: 39:ECDHE-PSK-AES256-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 40:SRP-RSA-AES-256-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 41:SRP-AES-256-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 42:RSA-PSK-AES256-CBC-SHA384
71: 20230711 155538.040 SSL cipher available: 43:DHE-PSK-AES256-CBC-SHA384
71: 20230711 155538.040 SSL cipher available: 44:RSA-PSK-AES256-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 45:DHE-PSK-AES256-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 46:AES256-SHA
71: 20230711 155538.040 SSL cipher available: 47:PSK-AES256-CBC-SHA384
71: 20230711 155538.040 SSL cipher available: 48:PSK-AES256-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 49:ECDHE-PSK-AES128-CBC-SHA256
71: 20230711 155538.040 SSL cipher available: 50:ECDHE-PSK-AES128-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 51:SRP-RSA-AES-128-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 52:SRP-AES-128-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 53:RSA-PSK-AES128-CBC-SHA256
71: 20230711 155538.040 SSL cipher available: 54:DHE-PSK-AES128-CBC-SHA256
71: 20230711 155538.040 SSL cipher available: 55:RSA-PSK-AES128-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 56:DHE-PSK-AES128-CBC-SHA
71: 20230711 155538.040 SSL cipher available: 57:AES128-SHA
71: 20230711 155538.040 SSL cipher available: 58:PSK-AES128-CBC-SHA256
71: 20230711 155538.040 SSL cipher available: 59:PSK-AES128-CBC-SHA
71: 20230711 155538.040 the src string is truncated
71: 20230711 155538.040 SSL handshake started write:unknown:unknown
71: 20230711 155538.040 SSL state connect:before SSL initialization:(NONE)
71: 20230711 155538.040 sent 0 256 buflen 5
71: 20230711 155538.041 sent 772 22 buflen 306
71: 20230711 155538.041 SSL state connect:SSLv3/TLS write client hello:(NONE)
71: 20230711 155538.041 SSL connect:SSLv3/TLS write client hello
71: 20230711 155538.041 SSLSocket error WANT_READ/WANT_WRITE
71: 20230711 155538.041 m->c->connect_state = 2
71: 20230711 155538.041 received 0 256 buflen 5
71: 20230711 155538.041 SSL state connect:SSLv3/TLS write client hello:(NONE)
71: 20230711 155538.041 received 772 22 buflen 69
71: 20230711 155538.041 received 0 256 buflen 5
71: 20230711 155538.041 SSL state connect:SSLv3/TLS read server hello:(NONE)
71: 20230711 155538.041 received 771 22 buflen 2880
71: 20230711 155538.041 sent 0 256 buflen 5
71: 20230711 155538.041 sent 771 21 buflen 2
71: 20230711 155538.041 SSL alert write:fatal:unknown CA
71: 20230711 155538.041 SSL connect:error
71: 20230711 155538.041 SSLSocket error (1) in SSL_connect for socket 5 rc -1 errno 0 Success
71: 
71: 20230711 155538.041 Removed socket 5
71: 20230711 155538.041 Removed socket 5
71: 20230711 155538.041 0 inflight messages deleted for client test2a
71: 20230711 155538.041 0 responses removed for client test2a
71: 20230711 155538.044 Calling connect failure for client test2a
71: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 757, description: There should be no failures in this test. test2aOnConnectFailure callback was called
71: 20230711 155538.044 Could not find client corresponding to socket 5
71: 20230711 155538.044 0 inflight messages deleted for client test2a
71: 20230711 155538.044 0 responses removed for client test2a
71: 20230711 155538.044 0 responses removed for client test2a
71: 20230711 155538.044 0 commands removed for client test2a
71: 20230711 155538.044 Removed client test2a from bstate->clients, socket 0
71: 20230711 155538.044 Conn_count is 0
71: 20230711 155538.044 sleeping
71: 20230711 155538.149 failed: test test2a. 4 tests run, 1 failures.
71: 20230711 155538.149 Total tests run: 4
71: 20230711 155538.149 verdict fail
 71/151 Test  #71: test5-2a-mutual-ssl-auth-certificates-in-place .......................***Failed    1.23 sec

This is output of tests 87 and 88 and it seems to be similar to the output of tests: 85-86.
Those tests fails for a SSL connection issue, but I don't undertand what really happens here.

test 87
        Start  87: test5-7-big-messages

87: Test command: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test5 "--test_no" "10" "--hostname" "localhost" "--client_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/client.pem" "--server_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/test-root-ca.crt"
87: Working Directory: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test
87: Test timeout computed to be: 540
87: Setting connection to ssl://localhost:18883
87: Setting mutual_auth_connection to ssl://localhost:18884
87: Setting nocert_mutual_auth_connection to ssl://localhost:18887
87: Setting server_auth_connection to ssl://localhost:18885
87: Setting anon_connection to ssl://localhost:18886
87: Setting psk_connection to ssl://localhost:18888
87: 20230711 155639.826 Starting test 7 - big messages
87: =========================================================
87:                    Trace Output
87: Product name: Eclipse Paho Asynchronous MQTT C Client Library
87: Version: 1.3.12
87: Build level: 2023-07-11T13:32:56Z
87: OpenSSL version: OpenSSL 1.1.1u  30 May 2023
87: OpenSSL flags: compiler: x86_64-pc-linux-gnu-gcc -fPIC -pthread -m64 -Wa,--noexecstack -march=core-avx2 -O2 -pipe -fno-strict-aliasing -Wa,--noexecstack -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DRC4_ASM -DMD5_ASM -DAESNI_ASM -DVPAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DX25519_ASM -DPOLY1305_ASM -DNDEBUG  -DOPENSSL_NO_BUF_FREELISTS
87: OpenSSL build timestamp: built on: Sat Jul  8 17:43:15 2023 UTC
87: OpenSSL platform: platform: linux-x86_64
87: OpenSSL directory: OPENSSLDIR: "/etc/ssl"
87: /proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023
87: 
87: =========================================================
87: 19700101 010000.000 0 commands restored for client async_test_7
87: 19700101 010000.000 0 queued messages restored for client async_test_7
87: 19700101 010000.000 Connecting to serverURI localhost:18885 with MQTT version 4
87: 19700101 010000.000 New socket 5 for localhost:18885, port 18885
87: 19700101 010000.000 Connect pending
87: 19700101 010000.000 m->c->connect_state = 1
87: 19700101 010000.000 SSL cipher available: 0:TLS_AES_256_GCM_SHA384
87: 19700101 010000.000 SSL cipher available: 1:TLS_CHACHA20_POLY1305_SHA256
87: 19700101 010000.000 SSL cipher available: 2:TLS_AES_128_GCM_SHA256
87: 19700101 010000.000 SSL cipher available: 3:ECDHE-ECDSA-AES256-GCM-SHA384
87: 19700101 010000.000 SSL cipher available: 4:ECDHE-RSA-AES256-GCM-SHA384
87: 19700101 010000.000 SSL cipher available: 5:DHE-RSA-AES256-GCM-SHA384
87: 19700101 010000.000 SSL cipher available: 6:ECDHE-ECDSA-CHACHA20-POLY1305
87: 19700101 010000.000 SSL cipher available: 7:ECDHE-RSA-CHACHA20-POLY1305
87: 19700101 010000.000 SSL cipher available: 8:DHE-RSA-CHACHA20-POLY1305
87: 19700101 010000.000 SSL cipher available: 9:ECDHE-ECDSA-AES128-GCM-SHA256
87: 19700101 010000.000 SSL cipher available: 10:ECDHE-RSA-AES128-GCM-SHA256
87: 19700101 010000.000 SSL cipher available: 11:DHE-RSA-AES128-GCM-SHA256
87: 19700101 010000.000 SSL cipher available: 12:ECDHE-ECDSA-AES256-SHA384
87: 20230711 155639.841 SSL cipher available: 13:ECDHE-RSA-AES256-SHA384
87: 20230711 155639.841 SSL cipher available: 14:DHE-RSA-AES256-SHA256
87: 20230711 155639.841 SSL cipher available: 15:ECDHE-ECDSA-AES128-SHA256
87: 20230711 155639.841 SSL cipher available: 16:ECDHE-RSA-AES128-SHA256
87: 20230711 155639.841 SSL cipher available: 17:DHE-RSA-AES128-SHA256
87: 20230711 155639.841 SSL cipher available: 18:ECDHE-ECDSA-AES256-SHA
87: 20230711 155639.841 SSL cipher available: 19:ECDHE-RSA-AES256-SHA
87: 20230711 155639.841 SSL cipher available: 20:DHE-RSA-AES256-SHA
87: 20230711 155639.841 SSL cipher available: 21:ECDHE-ECDSA-AES128-SHA
87: 20230711 155639.841 SSL cipher available: 22:ECDHE-RSA-AES128-SHA
87: 20230711 155639.841 SSL cipher available: 23:DHE-RSA-AES128-SHA
87: 20230711 155639.841 SSL cipher available: 24:RSA-PSK-AES256-GCM-SHA384
87: 20230711 155639.841 SSL cipher available: 25:DHE-PSK-AES256-GCM-SHA384
87: 20230711 155639.841 SSL cipher available: 26:RSA-PSK-CHACHA20-POLY1305
87: 20230711 155639.841 SSL cipher available: 27:DHE-PSK-CHACHA20-POLY1305
87: 20230711 155639.841 SSL cipher available: 28:ECDHE-PSK-CHACHA20-POLY1305
87: 20230711 155639.841 SSL cipher available: 29:AES256-GCM-SHA384
87: 20230711 155639.841 SSL cipher available: 30:PSK-AES256-GCM-SHA384
87: 20230711 155639.841 SSL cipher available: 31:PSK-CHACHA20-POLY1305
87: 20230711 155639.841 SSL cipher available: 32:RSA-PSK-AES128-GCM-SHA256
87: 20230711 155639.841 SSL cipher available: 33:DHE-PSK-AES128-GCM-SHA256
87: 20230711 155639.841 SSL cipher available: 34:AES128-GCM-SHA256
87: 20230711 155639.841 SSL cipher available: 35:PSK-AES128-GCM-SHA256
87: 20230711 155639.841 SSL cipher available: 36:AES256-SHA256
DEBUG 20230711 155639 Connection SNI info localhost
87: 20230711 155639.841 SSL cipher available: 37:AES128-SHA256
87: 20230711 155639.841 SSL cipher available: 38:ECDHE-PSK-AES256-CBC-SHA384
87: 20230711 155639.841 SSL cipher available: 39:ECDHE-PSK-AES256-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 40:SRP-RSA-AES-256-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 41:SRP-AES-256-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 42:RSA-PSK-AES256-CBC-SHA384
87: 20230711 155639.841 SSL cipher available: 43:DHE-PSK-AES256-CBC-SHA384
87: 20230711 155639.841 SSL cipher available: 44:RSA-PSK-AES256-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 45:DHE-PSK-AES256-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 46:AES256-SHA
87: 20230711 155639.841 SSL cipher available: 47:PSK-AES256-CBC-SHA384
87: 20230711 155639.841 SSL cipher available: 48:PSK-AES256-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 49:ECDHE-PSK-AES128-CBC-SHA256
87: 20230711 155639.841 SSL cipher available: 50:ECDHE-PSK-AES128-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 51:SRP-RSA-AES-128-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 52:SRP-AES-128-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 53:RSA-PSK-AES128-CBC-SHA256
87: 20230711 155639.841 SSL cipher available: 54:DHE-PSK-AES128-CBC-SHA256
87: 20230711 155639.841 SSL cipher available: 55:RSA-PSK-AES128-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 56:DHE-PSK-AES128-CBC-SHA
87: 20230711 155639.841 SSL cipher available: 57:AES128-SHA
87: 20230711 155639.841 SSL cipher available: 58:PSK-AES128-CBC-SHA256
87: 20230711 155639.841 SSL cipher available: 59:PSK-AES128-CBC-SHA
87: 20230711 155639.841 the src string is truncated
87: 20230711 155639.841 SSL handshake started write:unknown:unknown
87: 20230711 155639.841 SSL state connect:before SSL initialization:(NONE)
87: 20230711 155639.841 sent 0 256 buflen 5
87: 20230711 155639.841 sent 772 22 buflen 306
87: 20230711 155639.841 SSL state connect:SSLv3/TLS write client hello:(NONE)
87: 20230711 155639.841 SSL connect:SSLv3/TLS write client hello
87: 20230711 155639.841 SSLSocket error WANT_READ/WANT_WRITE
87: 20230711 155639.841 m->c->connect_state = 2
87: 20230711 155639.841 received 0 256 buflen 5
87: 20230711 155639.841 SSL state connect:SSLv3/TLS write client hello:(NONE)
87: 20230711 155639.841 received 772 22 buflen 69
87: 20230711 155639.841 received 0 256 buflen 5
87: 20230711 155639.843 SSL state connect:SSLv3/TLS read server hello:(NONE)
87: 20230711 155639.843 received 771 22 buflen 2880
87: 20230711 155639.843 sent 0 256 buflen 5
87: 20230711 155639.843 sent 771 21 buflen 2
87: 20230711 155639.843 SSL alert write:fatal:unknown CA
87: 20230711 155639.843 SSL connect:error
87: 20230711 155639.843 SSLSocket error (1) in SSL_connect for socket 5 rc -1 errno 0 Success
87: 
87: 20230711 155639.843 Removed socket 5
87: 20230711 155639.843 Removed socket 5
87: 20230711 155639.843 Connect failed, more to try
87: 20230711 155639.843 Could not find client corresponding to socket 5
87: 20230711 155639.843 Connecting to serverURI localhost:18885 with MQTT version 3
87: 20230711 155639.843 New socket 5 for localhost:18885, port 18885
87: 20230711 155639.843 Connect pending
87: 20230711 155639.843 m->c->connect_state = 1
87: 20230711 155639.843 SSL cipher available: 0:TLS_AES_256_GCM_SHA384
87: 20230711 155639.843 SSL cipher available: 1:TLS_CHACHA20_POLY1305_SHA256
87: 20230711 155639.843 SSL cipher available: 2:TLS_AES_128_GCM_SHA256
87: 20230711 155639.843 SSL cipher available: 3:ECDHE-ECDSA-AES256-GCM-SHA384
87: 20230711 155639.843 SSL cipher available: 4:ECDHE-RSA-AES256-GCM-SHA384
87: 20230711 155640.946 SSL cipher available: 5:DHE-RSA-AES256-GCM-SHA384
87: 20230711 155640.946 SSL cipher available: 6:ECDHE-ECDSA-CHACHA20-POLY1305
87: 20230711 155640.946 SSL cipher available: 7:ECDHE-RSA-CHACHA20-POLY1305
87: 20230711 155640.946 SSL cipher available: 8:DHE-RSA-CHACHA20-POLY1305
87: 20230711 155640.946 SSL cipher available: 9:ECDHE-ECDSA-AES128-GCM-SHA256
87: 20230711 155640.946 SSL cipher available: 10:ECDHE-RSA-AES128-GCM-SHA256
87: 20230711 155640.946 SSL cipher available: 11:DHE-RSA-AES128-GCM-SHA256
87: 20230711 155640.946 SSL cipher available: 12:ECDHE-ECDSA-AES256-SHA384
87: 20230711 155640.946 SSL cipher available: 13:ECDHE-RSA-AES256-SHA384
87: 20230711 155640.946 SSL cipher available: 14:DHE-RSA-AES256-SHA256
DEBUG 20230711 155640 Connection SNI info localhost
87: 20230711 155640.946 SSL cipher available: 15:ECDHE-ECDSA-AES128-SHA256
87: 20230711 155640.946 SSL cipher available: 16:ECDHE-RSA-AES128-SHA256
87: 20230711 155640.946 SSL cipher available: 17:DHE-RSA-AES128-SHA256
87: 20230711 155640.946 SSL cipher available: 18:ECDHE-ECDSA-AES256-SHA
87: 20230711 155640.946 SSL cipher available: 19:ECDHE-RSA-AES256-SHA
87: 20230711 155640.946 SSL cipher available: 20:DHE-RSA-AES256-SHA
87: 20230711 155640.946 SSL cipher available: 21:ECDHE-ECDSA-AES128-SHA
87: 20230711 155640.946 SSL cipher available: 22:ECDHE-RSA-AES128-SHA
87: 20230711 155640.946 SSL cipher available: 23:DHE-RSA-AES128-SHA
87: 20230711 155640.946 SSL cipher available: 24:RSA-PSK-AES256-GCM-SHA384
87: 20230711 155640.946 SSL cipher available: 25:DHE-PSK-AES256-GCM-SHA384
87: 20230711 155640.946 SSL cipher available: 26:RSA-PSK-CHACHA20-POLY1305
87: 20230711 155640.946 SSL cipher available: 27:DHE-PSK-CHACHA20-POLY1305
87: 20230711 155640.946 SSL cipher available: 28:ECDHE-PSK-CHACHA20-POLY1305
87: 20230711 155640.946 SSL cipher available: 29:AES256-GCM-SHA384
87: 20230711 155640.946 SSL cipher available: 30:PSK-AES256-GCM-SHA384
87: 20230711 155640.946 SSL cipher available: 31:PSK-CHACHA20-POLY1305
87: 20230711 155640.946 SSL cipher available: 32:RSA-PSK-AES128-GCM-SHA256
87: 20230711 155640.946 SSL cipher available: 33:DHE-PSK-AES128-GCM-SHA256
87: 20230711 155640.946 SSL cipher available: 34:AES128-GCM-SHA256
87: 20230711 155640.946 SSL cipher available: 35:PSK-AES128-GCM-SHA256
87: 20230711 155640.946 SSL cipher available: 36:AES256-SHA256
87: 20230711 155640.946 SSL cipher available: 37:AES128-SHA256
87: 20230711 155640.946 SSL cipher available: 38:ECDHE-PSK-AES256-CBC-SHA384
87: 20230711 155640.946 SSL cipher available: 39:ECDHE-PSK-AES256-CBC-SHA
87: 20230711 155640.946 SSL cipher available: 40:SRP-RSA-AES-256-CBC-SHA
87: 20230711 155640.946 SSL cipher available: 41:SRP-AES-256-CBC-SHA
87: 20230711 155640.946 SSL cipher available: 42:RSA-PSK-AES256-CBC-SHA384
87: 20230711 155640.946 SSL cipher available: 43:DHE-PSK-AES256-CBC-SHA384
87: 20230711 155640.946 SSL cipher available: 44:RSA-PSK-AES256-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 45:DHE-PSK-AES256-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 46:AES256-SHA
87: 20230711 155640.947 SSL cipher available: 47:PSK-AES256-CBC-SHA384
87: 20230711 155640.947 SSL cipher available: 48:PSK-AES256-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 49:ECDHE-PSK-AES128-CBC-SHA256
87: 20230711 155640.947 SSL cipher available: 50:ECDHE-PSK-AES128-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 51:SRP-RSA-AES-128-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 52:SRP-AES-128-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 53:RSA-PSK-AES128-CBC-SHA256
87: 20230711 155640.947 SSL cipher available: 54:DHE-PSK-AES128-CBC-SHA256
87: 20230711 155640.947 SSL cipher available: 55:RSA-PSK-AES128-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 56:DHE-PSK-AES128-CBC-SHA
87: 20230711 155640.947 SSL cipher available: 57:AES128-SHA
87: 20230711 155640.947 SSL cipher available: 58:PSK-AES128-CBC-SHA256
87: 20230711 155640.947 SSL cipher available: 59:PSK-AES128-CBC-SHA
87: 20230711 155640.947 the src string is truncated
87: 20230711 155640.947 SSL handshake started write:unknown:unknown
87: 20230711 155640.947 SSL state connect:before SSL initialization:(NONE)
87: 20230711 155640.947 sent 0 256 buflen 5
87: 20230711 155640.947 sent 772 22 buflen 306
87: 20230711 155640.947 SSL state connect:SSLv3/TLS write client hello:(NONE)
87: 20230711 155640.947 SSL connect:SSLv3/TLS write client hello
87: 20230711 155640.947 SSLSocket error WANT_READ/WANT_WRITE
87: 20230711 155640.947 m->c->connect_state = 2
87: 20230711 155640.947 received 0 256 buflen 5
87: 20230711 155640.947 SSL state connect:SSLv3/TLS write client hello:(NONE)
87: 20230711 155640.947 received 772 22 buflen 69
87: 20230711 155640.947 received 0 256 buflen 5
87: 20230711 155640.947 SSL state connect:SSLv3/TLS read server hello:(NONE)
87: 20230711 155640.947 received 771 22 buflen 2880
87: 20230711 155640.947 sent 0 256 buflen 5
87: 20230711 155640.947 sent 771 21 buflen 2
87: 20230711 155640.947 SSL alert write:fatal:unknown CA
87: 20230711 155640.947 SSL connect:error
87: 20230711 155640.947 SSLSocket error (1) in SSL_connect for socket 5 rc -1 errno 0 Success
87: 
87: 20230711 155640.947 Removed socket 5
87: 20230711 155640.947 Removed socket 5
87: 20230711 155640.947 0 inflight messages deleted for client async_test_7
87: 20230711 155640.947 0 responses removed for client async_test_7
87: 20230711 155640.947 Calling connect failure for client async_test_7
87: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 2108, description: There should be no failures in this test. test7OnConnectFailure callback was called
87: 20230711 155640.949 Could not find client corresponding to socket 5
87: 20230711 155640.949 0 inflight messages deleted for client async_test_7
87: 20230711 155640.949 0 responses removed for client async_test_7
87: 20230711 155640.949 0 responses removed for client async_test_7
87: 20230711 155640.949 0 commands removed for client async_test_7
87: 20230711 155640.949 Removed client async_test_7 from bstate->clients, socket 0
87: 20230711 155640.949 Conn_count is 0
87: 20230711 155640.949 sleeping
87: 20230711 155641.049 failed: test test7. 4 tests run, 1 failures.
87: 20230711 155641.049 Total tests run: 4
87: 20230711 155641.049 verdict fail
 87/151 Test  #87: test5-7-big-messages .................................................***Failed    1.23 sec

test 88
        Start  88: test5-7-ws-big-messages

88: Test command: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test/test5 "--test_no" "10" "--ws" "--hostname" "localhost" "--client_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/client.pem" "--server_key" "/var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/ssl/test-root-ca.crt"
88: Working Directory: /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12_build/test
88: Test timeout computed to be: 540
88: 
88: Setting websockets on
88: Setting connection to wss://localhost:18883
88: Setting mutual_auth_connection to wss://localhost:18884
88: Setting nocert_mutual_auth_connection to wss://localhost:18887
88: Setting server_auth_connection to wss://localhost:18885
88: Setting anon_connection to wss://localhost:18886
88: Setting psk_connection to wss://localhost:18888
88: 20230711 155641.055 Starting test 7 - big messages
88: =========================================================
88:                    Trace Output
88: Product name: Eclipse Paho Asynchronous MQTT C Client Library
88: Version: 1.3.12
88: Build level: 2023-07-11T13:32:56Z
88: OpenSSL version: OpenSSL 1.1.1u  30 May 2023
88: OpenSSL flags: compiler: x86_64-pc-linux-gnu-gcc -fPIC -pthread -m64 -Wa,--noexecstack -march=core-avx2 -O2 -pipe -fno-strict-aliasing -Wa,--noexecstack -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC -DOPENSSL_CPUID_OBJ -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSHA256_ASM -DSHA512_ASM -DKECCAK1600_ASM -DRC4_ASM -DMD5_ASM -DAESNI_ASM -DVPAES_ASM -DGHASH_ASM -DECP_NISTZ256_ASM -DX25519_ASM -DPOLY1305_ASM -DNDEBUG  -DOPENSSL_NO_BUF_FREELISTS
88: OpenSSL build timestamp: built on: Sat Jul  8 17:43:15 2023 UTC
88: OpenSSL platform: platform: linux-x86_64
88: OpenSSL directory: OPENSSLDIR: "/etc/ssl"
88: /proc/version: Linux version 6.1.31-gentoo (root@[mydomain]) (gcc (Gentoo 12.3.1_p20230526 p2) 12.3.1 20230526, GNU ld (Gentoo 2.39 p6) 2.39.0) #1 SMP PREEMPT_DYNAMIC Thu Jun 29 18:56:35 CEST 2023
88: 
88: =========================================================
88: 19700101 010000.000 0 commands restored for client async_test_7
88: 19700101 010000.000 0 queued messages restored for client async_test_7
88: 19700101 010000.000 Connecting to serverURI localhost:18885 with MQTT version 4
88: 19700101 010000.000 New socket 5 for localhost:18885, port 18885
88: 19700101 010000.000 Connect pending
88: 19700101 010000.000 m->c->connect_state = 1
88: 19700101 010000.000 SSL cipher available: 0:TLS_AES_256_GCM_SHA384
88: 19700101 010000.000 SSL cipher available: 1:TLS_CHACHA20_POLY1305_SHA256
88: 19700101 010000.000 SSL cipher available: 2:TLS_AES_128_GCM_SHA256
88: 19700101 010000.000 SSL cipher available: 3:ECDHE-ECDSA-AES256-GCM-SHA384
88: 19700101 010000.000 SSL cipher available: 4:ECDHE-RSA-AES256-GCM-SHA384
88: 19700101 010000.000 SSL cipher available: 5:DHE-RSA-AES256-GCM-SHA384
88: 19700101 010000.000 SSL cipher available: 6:ECDHE-ECDSA-CHACHA20-POLY1305
88: 19700101 010000.000 SSL cipher available: 7:ECDHE-RSA-CHACHA20-POLY1305
88: 19700101 010000.000 SSL cipher available: 8:DHE-RSA-CHACHA20-POLY1305
88: 19700101 010000.000 SSL cipher available: 9:ECDHE-ECDSA-AES128-GCM-SHA256
88: 19700101 010000.000 SSL cipher available: 10:ECDHE-RSA-AES128-GCM-SHA256
88: 19700101 010000.000 SSL cipher available: 11:DHE-RSA-AES128-GCM-SHA256
88: 19700101 010000.000 SSL cipher available: 12:ECDHE-ECDSA-AES256-SHA384
88: 20230711 155641.070 SSL cipher available: 13:ECDHE-RSA-AES256-SHA384
88: 20230711 155641.070 SSL cipher available: 14:DHE-RSA-AES256-SHA256
88: 20230711 155641.070 SSL cipher available: 15:ECDHE-ECDSA-AES128-SHA256
88: 20230711 155641.070 SSL cipher available: 16:ECDHE-RSA-AES128-SHA256
88: 20230711 155641.070 SSL cipher available: 17:DHE-RSA-AES128-SHA256
88: 20230711 155641.070 SSL cipher available: 18:ECDHE-ECDSA-AES256-SHA
88: 20230711 155641.070 SSL cipher available: 19:ECDHE-RSA-AES256-SHA
88: 20230711 155641.070 SSL cipher available: 20:DHE-RSA-AES256-SHA
88: 20230711 155641.070 SSL cipher available: 21:ECDHE-ECDSA-AES128-SHA
88: 20230711 155641.070 SSL cipher available: 22:ECDHE-RSA-AES128-SHA
88: 20230711 155641.070 SSL cipher available: 23:DHE-RSA-AES128-SHA
88: 20230711 155641.070 SSL cipher available: 24:RSA-PSK-AES256-GCM-SHA384
88: 20230711 155641.070 SSL cipher available: 25:DHE-PSK-AES256-GCM-SHA384
88: 20230711 155641.070 SSL cipher available: 26:RSA-PSK-CHACHA20-POLY1305
88: 20230711 155641.070 SSL cipher available: 27:DHE-PSK-CHACHA20-POLY1305
88: 20230711 155641.070 SSL cipher available: 28:ECDHE-PSK-CHACHA20-POLY1305
88: 20230711 155641.070 SSL cipher available: 29:AES256-GCM-SHA384
88: 20230711 155641.070 SSL cipher available: 30:PSK-AES256-GCM-SHA384
88: 20230711 155641.070 SSL cipher available: 31:PSK-CHACHA20-POLY1305
88: 20230711 155641.070 SSL cipher available: 32:RSA-PSK-AES128-GCM-SHA256
88: 20230711 155641.070 SSL cipher available: 33:DHE-PSK-AES128-GCM-SHA256
88: 20230711 155641.070 SSL cipher available: 34:AES128-GCM-SHA256
88: 20230711 155641.070 SSL cipher available: 35:PSK-AES128-GCM-SHA256
88: 20230711 155641.070 SSL cipher available: 36:AES256-SHA256
DEBUG 20230711 155641 Connection SNI info localhost
88: 20230711 155641.070 SSL cipher available: 37:AES128-SHA256
88: 20230711 155641.070 SSL cipher available: 38:ECDHE-PSK-AES256-CBC-SHA384
88: 20230711 155641.070 SSL cipher available: 39:ECDHE-PSK-AES256-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 40:SRP-RSA-AES-256-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 41:SRP-AES-256-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 42:RSA-PSK-AES256-CBC-SHA384
88: 20230711 155641.070 SSL cipher available: 43:DHE-PSK-AES256-CBC-SHA384
88: 20230711 155641.070 SSL cipher available: 44:RSA-PSK-AES256-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 45:DHE-PSK-AES256-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 46:AES256-SHA
88: 20230711 155641.070 SSL cipher available: 47:PSK-AES256-CBC-SHA384
88: 20230711 155641.070 SSL cipher available: 48:PSK-AES256-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 49:ECDHE-PSK-AES128-CBC-SHA256
88: 20230711 155641.070 SSL cipher available: 50:ECDHE-PSK-AES128-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 51:SRP-RSA-AES-128-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 52:SRP-AES-128-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 53:RSA-PSK-AES128-CBC-SHA256
88: 20230711 155641.070 SSL cipher available: 54:DHE-PSK-AES128-CBC-SHA256
88: 20230711 155641.070 SSL cipher available: 55:RSA-PSK-AES128-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 56:DHE-PSK-AES128-CBC-SHA
88: 20230711 155641.070 SSL cipher available: 57:AES128-SHA
88: 20230711 155641.070 SSL cipher available: 58:PSK-AES128-CBC-SHA256
88: 20230711 155641.070 SSL cipher available: 59:PSK-AES128-CBC-SHA
88: 20230711 155641.070 the src string is truncated
88: 20230711 155641.070 SSL handshake started write:unknown:unknown
88: 20230711 155641.070 SSL state connect:before SSL initialization:(NONE)
88: 20230711 155641.070 sent 0 256 buflen 5
88: 20230711 155641.070 sent 772 22 buflen 306
88: 20230711 155641.070 SSL state connect:SSLv3/TLS write client hello:(NONE)
88: 20230711 155641.070 SSL connect:SSLv3/TLS write client hello
88: 20230711 155641.070 SSLSocket error WANT_READ/WANT_WRITE
88: 20230711 155641.070 m->c->connect_state = 2
88: 20230711 155641.070 received 0 256 buflen 5
88: 20230711 155641.070 SSL state connect:SSLv3/TLS write client hello:(NONE)
88: 20230711 155641.070 received 772 22 buflen 69
88: 20230711 155641.070 received 0 256 buflen 5
88: 20230711 155641.072 SSL state connect:SSLv3/TLS read server hello:(NONE)
88: 20230711 155641.072 received 771 22 buflen 2880
88: 20230711 155641.072 sent 0 256 buflen 5
88: 20230711 155641.072 sent 771 21 buflen 2
88: 20230711 155641.072 SSL alert write:fatal:unknown CA
88: 20230711 155641.072 SSL connect:error
88: 20230711 155641.072 SSLSocket error (1) in SSL_connect for socket 5 rc -1 errno 0 Success
88: 
88: 20230711 155641.072 Removed socket 5
88: 20230711 155641.072 Removed socket 5
88: 20230711 155641.072 Connect failed, more to try
88: 20230711 155641.072 Could not find client corresponding to socket 5
88: 20230711 155641.072 Connecting to serverURI localhost:18885 with MQTT version 3
88: 20230711 155641.072 New socket 5 for localhost:18885, port 18885
88: 20230711 155641.072 Connect pending
88: 20230711 155641.072 m->c->connect_state = 1
88: 20230711 155641.072 SSL cipher available: 0:TLS_AES_256_GCM_SHA384
88: 20230711 155641.072 SSL cipher available: 1:TLS_CHACHA20_POLY1305_SHA256
88: 20230711 155641.072 SSL cipher available: 2:TLS_AES_128_GCM_SHA256
88: 20230711 155641.072 SSL cipher available: 3:ECDHE-ECDSA-AES256-GCM-SHA384
88: 20230711 155641.072 SSL cipher available: 4:ECDHE-RSA-AES256-GCM-SHA384
88: 20230711 155642.174 SSL cipher available: 5:DHE-RSA-AES256-GCM-SHA384
88: 20230711 155642.174 SSL cipher available: 6:ECDHE-ECDSA-CHACHA20-POLY1305
88: 20230711 155642.174 SSL cipher available: 7:ECDHE-RSA-CHACHA20-POLY1305
88: 20230711 155642.174 SSL cipher available: 8:DHE-RSA-CHACHA20-POLY1305
88: 20230711 155642.174 SSL cipher available: 9:ECDHE-ECDSA-AES128-GCM-SHA256
88: 20230711 155642.174 SSL cipher available: 10:ECDHE-RSA-AES128-GCM-SHA256
88: 20230711 155642.174 SSL cipher available: 11:DHE-RSA-AES128-GCM-SHA256
88: 20230711 155642.174 SSL cipher available: 12:ECDHE-ECDSA-AES256-SHA384
88: 20230711 155642.174 SSL cipher available: 13:ECDHE-RSA-AES256-SHA384
88: 20230711 155642.174 SSL cipher available: 14:DHE-RSA-AES256-SHA256
DEBUG 20230711 155642 Connection SNI info localhost
88: 20230711 155642.174 SSL cipher available: 15:ECDHE-ECDSA-AES128-SHA256
88: 20230711 155642.174 SSL cipher available: 16:ECDHE-RSA-AES128-SHA256
88: 20230711 155642.174 SSL cipher available: 17:DHE-RSA-AES128-SHA256
88: 20230711 155642.174 SSL cipher available: 18:ECDHE-ECDSA-AES256-SHA
88: 20230711 155642.174 SSL cipher available: 19:ECDHE-RSA-AES256-SHA
88: 20230711 155642.174 SSL cipher available: 20:DHE-RSA-AES256-SHA
88: 20230711 155642.174 SSL cipher available: 21:ECDHE-ECDSA-AES128-SHA
88: 20230711 155642.174 SSL cipher available: 22:ECDHE-RSA-AES128-SHA
88: 20230711 155642.174 SSL cipher available: 23:DHE-RSA-AES128-SHA
88: 20230711 155642.174 SSL cipher available: 24:RSA-PSK-AES256-GCM-SHA384
88: 20230711 155642.174 SSL cipher available: 25:DHE-PSK-AES256-GCM-SHA384
88: 20230711 155642.174 SSL cipher available: 26:RSA-PSK-CHACHA20-POLY1305
88: 20230711 155642.174 SSL cipher available: 27:DHE-PSK-CHACHA20-POLY1305
88: 20230711 155642.174 SSL cipher available: 28:ECDHE-PSK-CHACHA20-POLY1305
88: 20230711 155642.174 SSL cipher available: 29:AES256-GCM-SHA384
88: 20230711 155642.174 SSL cipher available: 30:PSK-AES256-GCM-SHA384
88: 20230711 155642.174 SSL cipher available: 31:PSK-CHACHA20-POLY1305
88: 20230711 155642.174 SSL cipher available: 32:RSA-PSK-AES128-GCM-SHA256
88: 20230711 155642.174 SSL cipher available: 33:DHE-PSK-AES128-GCM-SHA256
88: 20230711 155642.174 SSL cipher available: 34:AES128-GCM-SHA256
88: 20230711 155642.174 SSL cipher available: 35:PSK-AES128-GCM-SHA256
88: 20230711 155642.174 SSL cipher available: 36:AES256-SHA256
88: 20230711 155642.174 SSL cipher available: 37:AES128-SHA256
88: 20230711 155642.174 SSL cipher available: 38:ECDHE-PSK-AES256-CBC-SHA384
88: 20230711 155642.174 SSL cipher available: 39:ECDHE-PSK-AES256-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 40:SRP-RSA-AES-256-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 41:SRP-AES-256-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 42:RSA-PSK-AES256-CBC-SHA384
88: 20230711 155642.174 SSL cipher available: 43:DHE-PSK-AES256-CBC-SHA384
88: 20230711 155642.174 SSL cipher available: 44:RSA-PSK-AES256-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 45:DHE-PSK-AES256-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 46:AES256-SHA
88: 20230711 155642.174 SSL cipher available: 47:PSK-AES256-CBC-SHA384
88: 20230711 155642.174 SSL cipher available: 48:PSK-AES256-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 49:ECDHE-PSK-AES128-CBC-SHA256
88: 20230711 155642.174 SSL cipher available: 50:ECDHE-PSK-AES128-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 51:SRP-RSA-AES-128-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 52:SRP-AES-128-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 53:RSA-PSK-AES128-CBC-SHA256
88: 20230711 155642.174 SSL cipher available: 54:DHE-PSK-AES128-CBC-SHA256
88: 20230711 155642.174 SSL cipher available: 55:RSA-PSK-AES128-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 56:DHE-PSK-AES128-CBC-SHA
88: 20230711 155642.174 SSL cipher available: 57:AES128-SHA
88: 20230711 155642.174 SSL cipher available: 58:PSK-AES128-CBC-SHA256
88: 20230711 155642.174 SSL cipher available: 59:PSK-AES128-CBC-SHA
88: 20230711 155642.174 the src string is truncated
88: 20230711 155642.174 SSL handshake started write:unknown:unknown
88: 20230711 155642.174 SSL state connect:before SSL initialization:(NONE)
88: 20230711 155642.174 sent 0 256 buflen 5
88: 20230711 155642.174 sent 772 22 buflen 306
88: 20230711 155642.175 SSL state connect:SSLv3/TLS write client hello:(NONE)
88: 20230711 155642.175 SSL connect:SSLv3/TLS write client hello
88: 20230711 155642.175 SSLSocket error WANT_READ/WANT_WRITE
88: 20230711 155642.175 m->c->connect_state = 2
88: 20230711 155642.175 received 0 256 buflen 5
88: 20230711 155642.175 SSL state connect:SSLv3/TLS write client hello:(NONE)
88: 20230711 155642.175 received 772 22 buflen 69
88: 20230711 155642.175 received 0 256 buflen 5
88: 20230711 155642.175 SSL state connect:SSLv3/TLS read server hello:(NONE)
88: 20230711 155642.175 received 771 22 buflen 2880
88: 20230711 155642.175 sent 0 256 buflen 5
88: 20230711 155642.175 sent 771 21 buflen 2
88: 20230711 155642.175 SSL alert write:fatal:unknown CA
88: 20230711 155642.175 SSL connect:error
88: 20230711 155642.175 SSLSocket error (1) in SSL_connect for socket 5 rc -1 errno 0 Success
88: 
88: 20230711 155642.175 Removed socket 5
88: 20230711 155642.175 Removed socket 5
88: 20230711 155642.175 0 inflight messages deleted for client async_test_7
88: 20230711 155642.175 0 responses removed for client async_test_7
88: 20230711 155642.175 Calling connect failure for client async_test_7
88: Assertion failed, file /var/tmp/portage/dev-libs/paho-mqtt-c-1.3.12-r1/work/paho.mqtt.c-1.3.12/test/test5.c, line 2108, description: There should be no failures in this test. test7OnConnectFailure callback was called
88: 20230711 155642.176 Could not find client corresponding to socket 5
88: 20230711 155642.176 0 inflight messages deleted for client async_test_7
88: 20230711 155642.176 0 responses removed for client async_test_7
88: 20230711 155642.176 0 responses removed for client async_test_7
88: 20230711 155642.176 0 commands removed for client async_test_7
88: 20230711 155642.176 Removed client async_test_7 from bstate->clients, socket 0
88: 20230711 155642.176 Conn_count is 0
88: 20230711 155642.176 sleeping
88: 20230711 155642.277 failed: test test7. 4 tests run, 1 failures.
88: 20230711 155642.277 Total tests run: 4
88: 20230711 155642.277 verdict fail
 88/151 Test  #88: test5-7-ws-big-messages ..............................................***Failed    1.23 sec

Answer 7 · 2023-07-12T11:01:40.000Z

There are some non-TLS tests failing as well I think. Like those in test9.c? It would be useful to get a trace from one of those too.

I updated the TLS certificates in April this year because they had expired, but I thought all the repos, both in the test broker and the Paho C client branches had been updated. Make sure you have the latest updates of each.

I presume you're using the master branch? Could try the develop branch to see if it's any different.

The fact that you needed to add a 2 second delay to allow the broker to start leads me to think that maybe timing is a factor. But I'm just

This setup works as CI tests on Linux and MacOS (see the Github actions on this repo), and Windows on AppVeyor (https://ci.appveyor.com/project/eclipsewebmaster/paho-mqtt-c/history), so I'm a bit surprised by these failures. Maybe it's some combination of build parameters that I haven't used?

Answer 8 · 2023-07-14T22:09:11.000Z

I was trying to test the 1.3.12 release and not the live repo.
After updating all the test/ssl directory in the 1.3.12 archive with the one actually present in the master branch, this is the result

The following tests FAILED:
	 58 - test4-6-ha-connections (Timeout)
	 66 - test45-6-ha-connections (Timeout)
	105 - test9-2-offline-buffering-send-disconnected-serverURIs (Failed)
	107 - test9-4-offline-buffering-auto-reconnect-serverURIs (Timeout)
	113 - test9-2-ws-offline-buffering-send-disconnected-serverURIs (Failed)
	115 - test9-4-ws-offline-buffering-auto-reconnect-serverURIs (Timeout)
	121 - test95-2-offline-buffering-send-disconnected-serverURIs (Timeout)
	123 - test95-4-offline-buffering-auto-reconnect-serverURIs (Timeout)
	127 - test95-2ws-offline-buffering-send-disconnected-serverURIs (Timeout)
	129 - test95-4ws-offline-buffering-auto-reconnect-serverURIs (Timeout)

I will try to use MQTTASYNC_TRACE_MINIMUM in test9.c and test95.c to see if there is something useful in the output

Answer 9 · 2023-07-16T19:44:07.000Z

Hi @icraggs I have run the tests more times. Sometimes by changing MQTTASYNC_TRACE_ERROR to MQTTASYNC_TRACE_MINIMUM in tests' sources (test4.c test45.c test9.c and test95.c) and sometimes by leaving sources as they are.
Now all the tests pass. I don't know why they didn't pass in previous runs.
I am trying to investigate this more in depth, but I think we can close this issue.
Thanks a lot for your help and your work.

Answer 10 · 2023-07-17T11:44:07.000Z

OK thanks for letting me know.