makeabilitylab/makeabilitylabwebsite

Google not indexing the Makeability Lab website

Opened this issue · 5 comments

For some reason, the Makeability Lab website is not being indexed correctly by Google. I noticed that if you search for a project like "HandSight Makeability Lab" that none of the results include the actual HandSight project page.

Perhaps relatedly, I recently received this notification from Google.

image

Google has validated your fix of Page indexing issues on site https://makeabilitylab.cs.washington.edu/. The specific issue validated was: Duplicate without user-selected canonical.

I then followed the link and it brought me here
image

More investigation is needed.

OK, if you use this Search Console Inspect tool on Makeabiltiy Lab urls like HandSight, you can see that robots.txt is not available and so not indexing our website

image

In fact, the entire Makeability Lab website does not appear on Google atm:

image

it appears to be on Bing:
image

Matt got back to me and said he tried to fix this. Something appears to now be working as I can at least submit the Makeability Lab website to be indexed:

image

This continues to be a problem. I can seem to get content indexed if I specifically add the page; however, as of now, we have 606 pages that are not indexed on the Makeability Lab website: 513 of these are marked as "crawled by not currently indexed"

image

You can see that we started to lose our indexing around Nov 2023:

image

This continues to be an issue for some pages:
image

For example, I searched "makeabilitylab handsight" and it didn't come up correctly in Google (interestingly, some newer projects are fine like "makeabilitylab mobiprint")

So, now trying to add handsight project manually
image

And other manually:
image

But many projects I spot checked were already on there...