yujiosaka/headless-chrome-crawler

Suggestion: crawl results can be saved as sitemap.xml

kamanwu-oicr opened this issue · 4 comments

Use a crawler to generator the sitemap.xml dynamically. Is this a new feature or exist feature?

sitemap-generator is for static html

Yes, but sitemap-generator can generate sitemaps dynamically. Now I see the OP is probably interested in generating dynamic sitemaps for dynamic sites.

@kamanwu-oicr did you figure it out?