knu/webrobots
github.com
"A Ruby library to help write robots.txt compliant web robots"
Lulz. Do the opposite. Make a ruby liby to help write web robots that go out of their way to not be compliant with robots.txt.
#lulz #idea #pub
Collect and share the web
Get started for free