[Pairing Reliability] #1 Failure: Commission failed with src/app/ClusterStateCache.cpp:303: CHIP Error 0x00000010: Key not found

[Saravana-kr22]

Description:
I have used python controller to run a stress test on my RPI sample dut (all-clusters-app) on Pair-Unpair test scenario for 10,000 iterations. The test passed in iteration 2763 without any error but the iteration 2764 is Failed to read the info such BasicCommissioningInfo, RegulatoryConfig , LocationCapability, Breadcrumb during commission the dut with the below error

2024-04-26 05:40:48,629 - chip.native.CTL - ERROR - init.py:_RedirectToPythonLogging:38 - Failed to read BasicCommissioningInfo: src/app/ClusterStateCache.cpp:303: CHIP Error 0x00000010: Key not found
2024-04-26 05:40:48,630 - chip.native.CTL - ERROR - init.py:_RedirectToPythonLogging:38 - Failed to read RegulatoryConfig: src/app/ClusterStateCache.cpp:303: CHIP Error 0x00000010: Key not found
2024-04-26 05:40:48,630 - chip.native.CTL - ERROR - init.py:_RedirectToPythonLogging:38 - Failed to read LocationCapability: src/app/ClusterStateCache.cpp:303: CHIP Error 0x00000010: Key not found
2024-04-26 05:40:48,630 - chip.native.CTL - ERROR - init.py:_RedirectToPythonLogging:38 - Failed to read Breadcrumb: src/app/ClusterStateCache.cpp:303: CHIP Error 0x00000010: Key not found
2024-04-26 05:40:48,631 - chip.native.CTL - ERROR - init.py:_RedirectToPythonLogging:38 - Error parsing commissioning information
2024-04-26 05:40:48,631 - chip.native.CTL - ERROR - init.py:_RedirectToPythonLogging:38 - Error on commissioning step 'ReadCommissioningInfo2': 'src/app/ClusterStateCache.cpp:303: CHIP Error 0x00000010: Key not found'

GitHub hash of the SDK that was being used: 3718e99

Platform
controller - python controller running on raspi,
DUT - all-cluster-app running on raspi

Provisioned using on-network

Platform Version(s)
RPI-4, 8GB RAM

Test Scenario

Pair/Provision the DUT (All-cluster-app running on raspi) using on-network
Read device information after the device is provisioned
sleep for 2 secs
Unpair the DUT (i.e. removing the fabric)
factory reset the DUT
repeat step1 - 6 for 10,000 iterations
Script reference: https://github.com/CHIP-Specifications/matter-qa/blob/main/src/matter_qa/scripts/reliability_scripts/TC_Pair.py

Reference log:
Example of Passed iteration details:

The iteration number 2763 is passed, below log files for the same
TH log: log_2024-04-26_05-36-23.log
DUT log: Dut_log_2763_2024-04-26T05_36_32_752483.log

Example of Failed iteration details:

The iteration number 2764 is failed with this error below the logfile
TH log : log_2024-04-26_05-36-46.log
DUT log: Dut_log_2764_2024-04-26T05_40_57_865104.log

For the detailed summary please reference this json: summary.json