0xERR0R/blocky

parse error: line 254675: non resumable parse error: context deadline exceeded

szinn opened this issue · 3 comments

On large lists, I'm getting parse error: line 254675: non resumable parse error: context deadline exceeded consistently after a random number of lines.

The result is the full block list isn't loaded, but the ones loaded overwrite the current list. There also doesn't seem to be a retry.

This is problematic - if the full ad list can't be fetched, it shouldn't be processed at all.

Propose that the list is fetched to a temporary local storage and only if successful, process list.

In addition, if the list isn't retrievable, then retry according to the retry settings.

May 23 09:58:08 titan blocky[27382]: [2024-05-23 09:58:08] ERROR list_cache: parse error: line 254675: non resumable parse error: context deadline exceeded (Client.Timeout or context cancellation while reading body) count=254560 source=https://blocklistproject.github.io/Lists/malware.txt```

You could increase the timeout which is set to five seconds by default:

blocking:
  loading:
    downloads:
      timeout: 30s # for example (default: 5s)