{Parse /robots.txt file}

WWW: https://metacpan.org/pod/WWW::RobotRules
