google/safebrowsing

Which database is being used to persist the hashes ?

Closed this issue · 2 comments

In the code i see that the hashes are being persisted to file and on startup the db is being populated from previously existing file.
What are these files ? Can they be normal text files ?
I'm not familiar with go that's why i'm facing trouble understanding the code.

As mentioned in another issue, the "database" is just the in-memory structure containing hash prefixes and other blacklist metadata. As far as saving/loading files goes, the code is using the gob package, which serializes a Go data structure into a binary format. In addition, the file is gzipped to save space. So the in-memory structure is being serialized and compressed as it is written to the disk.

dsnet commented

The "another issue" in question is #21, see my answer there.

In retrospect, the database should have been renamed "filter" or something. Ooops.