7c/fakefilter

API Changes

Closed this issue · 1 comments

7c commented

After 1 year of operation, we see a more clear picture of this niche. We see that some providers

  • use random subdomains
  • share domains or even hostnames across different providers

Our current data structure cannot capture these cases. We will first change how the API filters hostnames at is/fakedomain/$domain and is/fakeemail/$email endpoints to the domain level. We believe that we should be banning the domain itself instead of the domain:
image

We will soon consider any subdomain of a known fake domain as fake too. We parse domains based on 'Public Suffix List' and will use the library https://github.com/lupomontero/psl to determine what part is a domain. In PSL terminology, even though 'clouddns.asia' is the domain, it considers cr.clouddns.asia. as the domain because the clouddns.asia is a known entity of giving subdomains. We previously considered *@b.cr.clouddns.asia as fake domain but was not checking for *@other.cr.clpouddns.asia, soon we will consider *@*.cr.clouddns.asia as fake domain.

In the case of line.pm domain we will consider *@*.line.pm including *@line.pm as fake domain.

7c commented

API server has been deployed. New verison 1.1 has IDN Domain support, Domain ban support, New JSON format at https://github.com/7c/fakefilter/blob/main/json/data_version2.json