18F/site-scanning

MVP the Website Index Repo

Closed this issue · 2 comments

Ideas for sections:

  • Readme that gives context for the project
  • Descriptions of major data assets
  • Methodology of assembling the index
  • Link to a public google sheet
  • Methodology of how to think about core terms: domains, websites, agencies
  • http vs https; www vs no www
  • Background on other domains (e.g. .mil) and state/local
  • Blacklist
  • Feedback mechanism