Cwe exit resulted in total task stuck
Opened this issue · 1 comments
FACT version
4.2dev
Environment
ubuntu20
Steps to reproduce
After I submitted the task, the progress did not change and it kept getting stuck. I checked the log and found that all four workers were ultimately assigned to CWE. I checked through Docker PS and found that there were no tasks assigned to CWE. It should have been an exception or a timeout exit, but the new task was not scheduled. How can I solve this bug
Expeced Behavior
finish
Installation logs
install.log
PASTE HERE
Backend logs
fact_main_backend.log
PASTE HERE
Frontend logs
fact_main_frontend.log
PASTE HERE
Other information
No response
The screenshots you posted don't really seem unusual: The cwe_checker plugin can be very slow depending on the size and number of binaries contained in the firmware (each individual analysis can take up to 10 minutes). It is not unusual for the cwe_checker analysis to take multiple hours if you run it on a whole firmware. Are you sure the analysis isn't still running? If you look at the plugin status (below the "current analyses" on the system page), what is the status displayed there?
The second number (from the left) is the number of currently running analysis workers for this plugin and the third is the task queue of the plugin. Are both of these numbers 0? If the numbers are not 0, the analysis is still running. If both of the numbers are 0 for all plugins but the analysis progress did not reach 100%, then there were probably some errors which resulted in the files being dropped from scheduling (the analysis is actually finished then and you need to restart FACT for the entry to be removed). Did you observe any errors outside of the plugin code of the cwe_checker?
Can you confirm that the docker image of the cwe_checker was built correctly? What is the output of docker image ls | grep cwe?
This pull request fixed a bug in the cwe_checker plugin (the memory of individual analysis workers was not limited). Is your FACT instance already using this fix?