vezaynk/Sitemap-Generator-Crawler

Issues

• How to setup page I need ?

  #101 opened 5 months ago by nethiker76
  1

• Does not work with the following website address...

  #100 opened a year ago by duongkyvuong
  1

• Add a log with links, contains url returns 404

  #99 opened a year ago by oim37
  2

• [!] Reformatted site from https://example.com/folder/#with_index.php# to https://example.com/

  #96 opened 3 years ago by martianmaikel
  8

• Sitemap limits checking is missing

  #43 opened 7 years ago
  6

• Does not work with Real Estate FLOWFACT Wordpress Plugin generated Object Pages

  #98 opened 3 years ago by Zorast
  3

• Fails for Maximum allowed length

  #91 opened 4 years ago by canuck-sailor
  5

• "mmap failed... cannot allocate memory"

  #88 opened 3 years ago by tomjennings
  2

• What if my website has more then 50,000 pages

  #95 opened 3 years ago by Jaydeep-01
  1

• Could not find files for the given pattern(s)

  #93 opened 3 years ago by Jaydeep-01
  2

• Reports empty error after finishing

  #89 opened 3 years ago by mylselgan
  1

• Is there support for static sites defined locally

  #90 opened 3 years ago by KommuSoft
  4

• Specify for IP local sitemap generation

  #94 opened 3 years ago by vezaynk
  0

• Option to not crawl Frames

  #79 opened 3 years ago by kewh
  3

• Pls help me

  #92 opened 3 years ago by sirstevemedia
  1

• [Feature Request] List all kinds of files & add an option to not try to curl some extensions

  #87 opened 5 years ago by jean-christophe-manciot
  1

• "noindex" URL are listed in sitemap

  #82 opened 6 years ago by stephanros
  12

• Remove WINNT check for argument processing

  #86 opened 5 years ago by jamesjohnmcguire
  2

• only creating one URL where I have 700+

  #85 opened 5 years ago by tejalbaria5
  7

• sitemap.xml access denied can't open

  #81 opened 6 years ago by Ganofins
  4

• Empty sitemap close

  #80 opened 6 years ago by MattMski
  0

• Last modified date always set to current date/time

  #76 opened 6 years ago by kewh
  0

• <iframe> tags ignored

  #78 opened 6 years ago by kewh
  1

• Some things added

  #73 opened 6 years ago by brunoabcn
  2

• Little problems with &

  #75 opened 6 years ago by webapteka
  1

• Please move the project away from GitHub

  #74 opened 6 years ago
  1

• Crawling the root website instead of sub-root

  #72 opened 7 years ago by yashitgarg
  4

• Adds only the main page :(

  #71 opened 7 years ago by webapteka
  1

• Why not a plugin?

  #50 opened 7 years ago by rsm23
  4

• Sitemap.xml access denied can't open generated xml file

  #65 opened 7 years ago by gomathyfollowon
  9

• Switch from arrays to hashtables

  #68 opened 7 years ago by vezaynk
  1

• Tracking deferred scans

  #67 opened 7 years ago by vezaynk
  1

• banned pagination url

  #64 opened 7 years ago by jazuly1
  1

• Blacklist not working

  #66 opened 7 years ago by Kristiansky
  9

• INFO: Could not find files for the given pattern(s).

  #63 opened 7 years ago by blacksmoke26
  2

• Retrieve and parse header before requesting the full page

  #59 opened 7 years ago by vezaynk
  20

• Output file permissions

  #60 opened 7 years ago by vezaynk
  1

• Non-ascii urls fail to validate

  #57 opened 7 years ago by mazux
  18

• Add version checks between the script and config file

  #45 opened 7 years ago by vezaynk
  0

• Whitelist GET arguments

  #31 opened 7 years ago by vezaynk
  1

• HTML base element

  #46 opened 7 years ago by Thyra
  1

• Dropping pound

  #48 opened 7 years ago
  9

• Index PDFs

  #40 opened 7 years ago by vezaynk
  0

• Canonical URL

  #47 opened 7 years ago
  0

• Entity escaping is missing

  #42 opened 7 years ago
  5

• Standard output

  #36 opened 7 years ago
  9

• Indefinite loop

  #34 opened 7 years ago
  15

• Double entry

  #35 opened 7 years ago
  2

• Follow frames

  #39 opened 7 years ago by Thyra
  2

• Domain root links append a needless /

  #33 opened 7 years ago by vezaynk
  0