forgotten-roads/blog

Write CLI tool to test sitemap links

Opened this issue 7 years ago · 0 comments

bobbermac commented 7 years ago

Currently there are pages listed in the sitemap.xml file that aren't being indexed by Google:

https://www.google.com/webmasters/tools/sitemap-list?hl=en&authuser=0&siteUrl=http://forgotten.roads.mx/#MAIN_TAB=0&CARD_TAB=-1

It would be nice to be able to test this with the CLI:

Parse sitemap.xml for links
Use clj-http to get each page (HEAD should be fine ...)
Report on the status of the page
Update the frmx tool to support usage like frmx check sitemap urls