A ai datasets Success Story You'll Never Believe
https://www.instapaper.com/read/1677286358
This will permit Goggle (user-agent identify GoogleBot) to visit every page and directory, though simultaneously banning Question Jeeves with the site wholly