Architecture Philosophy This bot employs a 'Divide and Conquer' strategy. What it doesn't do: Grab all the document numbers first and then scrape them What it does: Grab a bunch of document numbers, suppose 100 from 5 pages. Scrape them, continue where left.