parse error: line 254675: non resumable parse error: context deadline exceeded
szinn opened this issue · 3 comments
szinn commented
On large lists, I'm getting parse error: line 254675: non resumable parse error: context deadline exceeded consistently after a random number of lines.
The result is the full block list isn't loaded, but the ones loaded overwrite the current list. There also doesn't seem to be a retry.
This is problematic - if the full ad list can't be fetched, it shouldn't be processed at all.
Propose that the list is fetched to a temporary local storage and only if successful, process list.
In addition, if the list isn't retrievable, then retry according to the retry settings.
May 23 09:58:08 titan blocky[27382]: [2024-05-23 09:58:08] ERROR list_cache: parse error: line 254675: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body) count=254560 source=https://blocklistproject.github.io/Lists/malware.txt```
kwitsch commented
You could increase the timeout which is set to five seconds by default:
blocking:
loading:
downloads:
timeout: 30s # for example (default: 5s)