{"id":3228,"date":"2003-07-11T10:50:14","date_gmt":"2003-07-11T10:50:14","guid":{"rendered":"https:\/\/ezoons.com\/?p=3228"},"modified":"2003-07-11T10:50:14","modified_gmt":"2003-07-11T10:50:14","slug":"annoying_spider","status":"publish","type":"post","link":"https:\/\/ezoons.com\/?p=3228","title":{"rendered":"Annoying Spiders"},"content":{"rendered":"<p>This morning I was glancing at my log files and noticed something quite odd:<\/p>\n<blockquote><p><code><br \/>\n193.29.77.* - - [11\/Jul\/2003:10:16:40 -0400] \"GET \/cgi-bin\/MT\/mt-tb.cgi?__mode=view&#38;entry_id=3218 HTTP\/1.0\" 200 939 \"-\" \"Mozilla\/4.0 (compatible; MSIE 6.0; Windows NT 5.1)\"<br \/>\n193.29.77.* - - [11\/Jul\/2003:10:16:51 -0400] \"GET \/2003\/07\/09\/because_everything_is_better_with_bukkake.html HTTP\/1.0\" 200 6390 \"-\" \"Mozilla\/5.0 (X11; U; SunOS sun4u; en-US; rv:1.0rc3) Gecko\/20020524\"<br \/>\n193.29.77.* - - [11\/Jul\/2003:10:16:56 -0400] \"GET \/cgi-bin\/MT\/mt-comments.cgi?entry_id=3217 HTTP\/1.0\" 200 6006 \"-\" \"Mozilla\/4.0 (SunOS 5.8)\"<br \/>\n193.29.77.* - - [11\/Jul\/2003:10:16:59 -0400] \"GET \/cgi-bin\/MT\/mt-tb.cgi?__mode=view&#38;entry_id=3217 HTTP\/1.0\" 200 961 \"-\" \"Mozilla\/4.61 [en] (OS\/2; U)\"<br \/>\n193.29.77.* - - [11\/Jul\/2003:10:17:06 -0400] \"GET \/2003\/07\/09\/qotd_07092003.html HTTP\/1.0\" 200 5166 \"-\" \"Mozilla\/5.0 (OS\/2; U; Warp 4.5; en-US; rv:0.9.8) Gecko\/20020204\"<br \/>\n193.29.77.* - - [11\/Jul\/2003:10:17:09 -0400] \"GET \/cgi-bin\/MT\/mt-comments.cgi?entry_id=3216 HTTP\/1.0\" 200 4912 \"-\" \"Mozilla\/4.0 (Windows XP 5.1)\"<br \/>\n193.29.77.* - - [11\/Jul\/2003:10:17:12 -0400] \"GET \/cgi-bin\/MT\/mt-tb.cgi?__mode=view&#38;entry_id=3216 HTTP\/1.0\" 200 877 \"-\" \"Mozilla\/5.0 (Windows XP; U) Opera 6.01  [en]\\\"\"<\/code>\n<\/p>\n<\/blockquote>\n<p>Notice anything interesting? Take a look at the <strike>referrer string<\/strike> User-agent. The ip is the same, but the referrer changes with every query.  What an ass.  Thanks to the power of mod_rewrite that person will no longer be crawling my site (Though it&#8217;s looking like I may just have to block his whole network).<\/p>\n<p><strong>Edit:<\/strong> I had to change the IP# because for some reason mod_rewrite of remote addr was catching the IP# in the log snipped above and screwing with the whole page.  Hmm. Sounds like a bug?<\/p>\n<p><strong>Another Edit:<\/strong> Oh yeah, and the other thing they were doing was ignoring my robots.txt<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This morning I was glancing at my log files and noticed something quite odd: 193.29.77.* &#8211; &#8211; [11\/Jul\/2003:10:16:40 -0400] &#8220;GET \/cgi-bin\/MT\/mt-tb.cgi?__mode=view&#38;entry_id=3218 HTTP\/1.0&#8221; 200 939 &#8220;-&#8221; &#8220;Mozilla\/4.0 (compatible; MSIE 6.0; Windows NT 5.1)&#8221; 193.29.77.* &#8211; &#8211; [11\/Jul\/2003:10:16:51 -0400] &#8220;GET \/2003\/07\/09\/because_everything_is_better_with_bukkake.html HTTP\/1.0&#8221; 200 6390 &#8220;-&#8221; &#8220;Mozilla\/5.0 (X11; U; SunOS sun4u; en-US; rv:1.0rc3) Gecko\/20020524&#8221; 193.29.77.* &#8211; &#8211; [11\/Jul\/2003:10:16:56 [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-3228","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/ezoons.com\/index.php?rest_route=\/wp\/v2\/posts\/3228","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ezoons.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ezoons.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ezoons.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ezoons.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3228"}],"version-history":[{"count":0,"href":"https:\/\/ezoons.com\/index.php?rest_route=\/wp\/v2\/posts\/3228\/revisions"}],"wp:attachment":[{"href":"https:\/\/ezoons.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3228"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ezoons.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3228"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ezoons.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3228"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}