hostnames count doesn't update when updated the HOST file lists

Question

hostnames count doesn't update when updated the HOST file lists

uBlock-user opened this issue 7 years ago · 40 comments

uBlock-user commented 7 years ago

STR

Open dashboard > Assets
Take a note of hostname count for Dan Pollocks host file which is 13,272 used out of 13,278 on my end, could be different on yours.
Click on clock icon to remove the cache
Click on Update Now button, once the update finishes the count remains the same i.e. 13,272 used out of 13,278 even though the list was updated 2 days ago, so either the count should go lower(if entries were removed) or go up(if new entries were added), instead no change is shown in the count.

uMatrix - 1.3.3.8
Chromium 66

Answer 1 · 2018-02-14T14:45:04.000Z

@gorhill same issue with custom hosts lists too.

Answer 2 · 2018-02-14T15:13:06.000Z

I don't see anything wrong. If I have only this one list enabled, the version shipped with uMatrix says "13,242 used out of 13,248". Forcing an update of the list results in the count becoming "13,272 used out of 13,278". Clicking the clock icon marks the list as out of date -- it does not remove the cache. Forcing an update of course will just cause the same version as the cached one to be downloaded, hence the count won't change.

Answer 3 · 2018-02-14T15:18:56.000Z

So why does it happen with the custom file list of mine ?

https://raw.githubusercontent.com/uBlock-user/uMatrix-Hosts-List/master/hosts.txt

Before update the total number is 24,149

I added a new entry called 0.0.0.0 analytics.github.com just to check whether it takes it or not.

I forced update, it remains the same as 24,149.

Then I remove the custom list by clicking the trash bin icon and add it back - the number changes to 24,150.

This didn't happen before. When I click Update now, it would fetch the newest version and the number would change i.e. become 24,150.

Can you explain that ?

Answer 4 · 2018-02-14T15:21:57.000Z

Did you verify that the list is not pulled from the browser cache?

Answer 5 · 2018-02-14T15:24:24.000Z

How do I verify that for this issue specifically ?

If I click on the listing it opens chrome-extension://eckgcipdkhcfghnmincccnhpdmnbefki/asset-viewer.html?url=https://raw.githubusercontent.com/uBlock-user/uMatrix-Hosts-List/master/hosts.txt

whichs shows the updated version, but the number count won't go up.

Answer 6 · 2018-02-14T15:32:34.000Z

Added another entry 0.0.0.0 analytics.screenrant.com to my listing.

Clicked on Purge All Caches and still no effect. The number remains the same even though the count should have gone up to 24,151 from 24,150. I suppose this is a cache issue.

This has never happened before, not sure why it is happening now.

Answer 7 · 2018-02-14T15:37:19.000Z

The only way it updates for me is if I remove the list and add it back.

Answer 8 · 2018-02-14T15:42:13.000Z

How do I verify that for this issue specifically ?

chrome://extensions/ => "Developer mode" enabled => uMatrix => Click background.html => Select Network pane => Force an update of the list => see if request if fetched from cache:

Also, sometime the server itself may serve its own cached version.

Answer 9 · 2018-02-14T15:45:11.000Z

Clicked on Purge All Caches and still no effect. The number remains the same even though the count should have gone up to 24,151 from 24,150.

Purging the cache just cause the list to be marked as "out of date" (making it a candidate for update), it does not remove it from uBO's cache.

Answer 10 · 2018-02-14T15:48:56.000Z

There you go -

It fetched 145 KB, so it's not from cache, and the number still remains the same.

I found this too in the console -

Answer 11 · 2018-02-14T16:06:56.000Z

Funny thing is, this doesn't happen with uBlock Origin, I mark it out of date and then click on Update now and it gets updated successfully.

Answer 12 · 2018-03-05T04:43:31.000Z

The issue is still going on, the number won't update after marking out of date and clicking on Update Now. This didn't happen before like this.

But if I deactivate the specific list, click Apply Changes and then activate and click Apply Changes again, the number updates.

Answer 13 · 2018-03-05T11:08:33.000Z

I explained above to you why this is this way.

Answer 14 · 2018-03-05T12:18:09.000Z

I'm asking for a solution, how do I deal with this ?

Answer 15 · 2018-03-05T12:36:59.000Z

A solution to what? There is no issue = nothing to solve. Having uMatrix fall back to the packaged version is not a desirable behavior. And even then, there is no guarantee that the number of hostnames in the packaged version will be different then the current one. You focus unduly on a number, what matters is whether the list is marked as obsolete or not.

Answer 16 · 2018-03-05T12:38:25.000Z

You focus unduly about a number

So how do I know that the list has been updated or not ? That number is the only way to know.

Answer 17 · 2018-03-05T13:00:51.000Z

So how do I know that the list has been updated or not ? That number is the only way to know.

Really? Guess which one is up to date and which is not up to date.

If you still do not trust, use the logger to see the network request being made. If you still do not trust all the evidences, the burden is on you to make the case there is an issue, not on me to convince you there is none -- I spent already way too much time on this non-issue.

Answer 18 · 2018-03-05T13:08:25.000Z

Fine, if that's the acceptable way then why is it different with uBlock Origin ? Why isn't the behavior same there ?

Answer 19 · 2018-03-05T13:25:18.000Z

There is no difference with uBO.

Answer 20 · 2018-03-05T13:38:31.000Z

The number updates after the update is complete with uBO, I see that as a difference.

Answer 21 · 2018-03-05T13:44:59.000Z

I did update and the number didn't change after the update was completed.

Answer 22 · 2018-03-05T13:48:07.000Z

On my end, it did.

Resource Abuse updated and this is the result..

Before update -

After update -

This is just one example, every list I update, gets a change in the number count if the change has been made by the maintainer, on uBO.

Answer 23 · 2018-03-05T13:51:57.000Z

So? You provide no details as to when was the last update for that resource.

Now try again:

Click the clock icon: number does not change
Click "Update now" and let it complete: number does not change

Answer 24 · 2018-03-05T13:53:42.000Z

So?

So I made my point, the number changes when I force update the list on uBO, since you said "There is no difference with uBO." That's the difference.

You provide no details as to when was the last update for that resource.

Few days ago, a week perhaps, I don't exactly keep a date in mind.

Answer 25 · 2018-03-05T13:54:37.000Z

Now try again:

Obviously it wouldn't change now, because I just updated it to show it to you and it just changed now.

Answer 26 · 2018-03-05T13:56:14.000Z

But in case of uMatrix, I updated the filter list today and there was no change, the last update I made was also a week ago. Do you get my point now ? If not, I rest my case. I can't be more crystal clear anymore.

Answer 27 · 2018-03-05T14:26:44.000Z

Do you get my point now ?

No. Note that only you is seeing an issue here. Feel free to find other people who can side with you and maybe explain in other words what I supposedly fail to understand.

Answer 28 · 2018-03-05T14:41:05.000Z

Feel free to find other people who can side with you

Why would I want anyone to "side" with me ? If people want to support on their own then it's fine. I don't want anyone to fight the case for me. I reported it because I'm facing a difficulty in ascertaining whether uMatrix was able to update the list or was it still pulling from the cache, and from the appearance it's still pulling the cache and since I'm the only one appear to having this issue, I will let it go.

Answer 29 · 2018-03-05T15:59:53.000Z

In Firefox 59.0b13, uMatrix 1.3.3b8, I just updated Peter Lowe's list (old list from March 3rd, new from March 5th) and the counter stays the same (it's still 1,753 used out of 2,583 despite the new list having 2,608 entries).

Unchecking the list -> apply changes -> check list -> apply changes again, and now the counter is updated (1,786 used out of 2,608).

And updating lists in uBlock, the counter indeed changes right away without having to uncheck lists (and has done so as long as I remember).

Edit: Same thing in Firefox 58.0.2 and Chromium 64.

Answer 30 · 2018-03-05T16:37:33.000Z

I think I am reproducing it now -- investigating.

Answer 31 · 2018-03-05T16:46:06.000Z

@uBlock-user You were right, I was wrong, sorry for wasting your time.

Answer 32 · 2018-03-05T16:50:21.000Z

I'm just glad this finally got your attention. Thanks to @nameless3 for taking his time and posting his findings.

Answer 33 · 2018-03-05T16:54:24.000Z

Was this a regression after implementing selfies in uMatrix ?

Answer 34 · 2018-03-05T17:02:33.000Z

Yes. I forgot how much stuff changed in the current beta -- I have been mostly working on uBO lately. I am not yet setup to publish a self-hosted signed version of uMatrix beta -- so for now I will have to push an unsigned version with the fix.

Answer 35 · 2018-03-07T15:15:12.000Z

@gorhill A vertical white space-line appears near the scroll bar in popup UI since 1.3.3.9

STR

Browse - https://www.washingtonpost.com/news/the-fix/wp/2018/03/07/the-7-most-interesting-parts-of-stormy-danielss-lawsuit-against-trump/

Open the popup UI

Notice the vertical white-space line near the scrollbar like this -

Answer 36 · 2018-03-07T15:26:17.000Z

There has been no change in that area in 1.3.3b9 relative to 1.3.3b8: 1.3.3b8...1.3.3b9.

Answer 37 · 2018-03-07T15:41:35.000Z

I haven't seen it before 1.3.3.9, can you take a look ? It only happens on websites where there are lots of connections made which causes the scrollbar to appear in the popup UI along with the vertical white space.

Answer 38 · 2018-03-07T16:31:39.000Z

I can not reproduce with Chromium 64.

I can reproduce with Chrome 66 (dev build).

So it looks like a regression in the dev build of the browser.

Answer 39 · 2018-05-25T11:52:19.000Z

I can still reproduce it on Chromium 68, I don't think it's a regression anymore, it would have been fixed by now.

Answer 40 · 2018-09-18T04:11:13.000Z

I can still reproduce it on Chromium 68, I don't think it's a regression anymore, it would have been fixed by now.

Doesn't happen in Chrome 71 appears to be been fixed, reproducible on 69 though, so it was a regression after all.