{"id":103521,"date":"2021-09-11T18:52:05","date_gmt":"2021-09-11T10:52:05","guid":{"rendered":"https:\/\/www.keaglegz.com\/103521.html"},"modified":"2021-09-11T18:52:05","modified_gmt":"2021-09-11T10:52:05","slug":"%e5%b1%8f%e8%94%bd%e7%96%af%e7%8b%82%e8%9c%98%e8%9b%9b%ef%bc%8c%e9%98%b2%e6%ad%a2cpu%e5%8d%a0%e7%94%a8100","status":"publish","type":"post","link":"https:\/\/www.dongwubaike.cn\/fanhao\/103521.html","title":{"rendered":"\u5c4f\u853d\u75af\u72c2\u8718\u86db\uff0c\u9632\u6b62cpu\u5360\u7528100%"},"content":{"rendered":"\n<p>\u7ad9\u70b9\u603b\u662f\u67d0\u4e2a\u65f6\u95f4\u6bb5\u83ab\u540d\u7684cpu100%\uff0c\u8d44\u6e90\u5360\u7528\u4e5f\u4e0d\u9ad8\uff0c\u8fd9\u5c31\u6709\u5fc5\u8981\u6000\u7591\u722c\u866b\u95ee\u9898\u3002<\/p>\n<h2>\u4f7f\u7528&#8221;robots.txt&#8221;\u89c4\u8303<\/h2>\n<p>\u5728\u7f51\u7ad9\u6839\u76ee\u5f55\u65b0\u5efa\u7a7a\u767d\u6587\u4ef6\uff0c\u547d\u540d\u4e3a&#8221;robots.txt&#8221;\uff0c\u5c06\u4e0b\u9762\u5185\u5bb9\u4fdd\u5b58\u5373\u53ef\u3002<\/p>\n<pre>  User-agent: Baiduspider  Disallow:  User-agent: YisouSpider  Disallow:  User-agent: 360Spider  Disallow:  User-agent: Sosospider  Disallow:  User-agent: sogou spider  Disallow:  User-agent: YodaoBot  Disallow:  User-agent: Googlebot  Disallow:  User-agent: bingbot  Disallow:  User-agent: *  Disallow: \/  <\/pre>\n<h2>\u901a\u8fc7nginx<\/h2>\n<p>\u6709\u4e9b\u722c\u866b\u662f\u4e0d\u6309\u89c4\u5219\u51fa\u724c\u7684\uff0c\u6211\u4eec\u5fc5\u987b\u8981\u80fd\u81ea\u5df1\u63a7\u5236\uff0c\u5c06\u4e0b\u9762\u4ee3\u7801\u6dfb\u52a0\u5230&#8221;location \/ {  }&#8221; \u6bb5\u91cc\u9762\uff0c\u6bd4\u5982\u4f2a\u9759\u6001\u89c4\u5219\u91cc\u9762\u5373\u53ef\u3002<\/p>\n<pre>  #\u7981\u6b62Scrapy\u7b49\u5de5\u5177\u7684\u6293\u53d6  if ($http_user_agent ~ (Scrapy|Curl|HttpClient)) {  return 403;  }    #\u7981\u6b62\u6307\u5b9aUA\u53caUA\u4e3a\u7a7a\u7684\u8bbf\u95ee  if ($http_user_agent ~ \"YandexBot|Bytespider|FeedDemon|Indy Library|Alexa Toolbar|AskTbFXTV|AhrefsBot|CrawlDaddy|CoolpadWebkit|Java|Feedly|UniversalFeedParser|ApacheBench|Microsoft URL Control|Swiftbot|ZmEu|oBot|jaunty|Python-urllib|lightDeckReports Bot|YYSpider|DigExt|HttpClient|MJ12bot|heritrix|Ezooms|^$\" ) {  return 403;  }  #\u7981\u6b62\u975eGET|HEAD|POST\u65b9\u5f0f\u7684\u6293\u53d6  if ($request_method !~ ^(GET|HEAD|POST)$) {  return 403;  }  <\/pre>\n<p>\u6ce8\u610f\uff1a<code>~<\/code>\u4e3a\u6a21\u7cca\u5339\u914d\uff0c<code>~*<\/code>\u4e3a\u6a21\u7cca\u5339\u914d\u4e0d\u533a\u5206\u5927\u5c0f\u5199<br \/> \u6d4b\u8bd5\u4e00\u4e0b\uff1a<br \/> <code>curl -I -A  \"Mozilla\/5.0 YandexBot demo\"  http:\/\/\u4f60\u7684\u57df\u540d<\/code><br \/> \u8fd4\u56de403\u8868\u793a\u8bbe\u7f6e\u6210\u529f\uff01<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u7ad9\u70b9\u603b\u662f\u67d0\u4e2a\u65f6\u95f4\u6bb5\u83ab\u540d\u7684cpu100%\uff0c\u8d44\u6e90\u5360\u7528\u4e5f\u4e0d\u9ad8\uff0c\u8fd9\u5c31\u6709\u5fc5\u8981\u6000\u7591\u722c\u866b\u95ee\u9898\u3002<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-103521","post","type-post","status-publish","format-standard","hentry"],"_links":{"self":[{"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/posts\/103521","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/comments?post=103521"}],"version-history":[{"count":0,"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/posts\/103521\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/media?parent=103521"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/categories?post=103521"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dongwubaike.cn\/fanhao\/wp-json\/wp\/v2\/tags?post=103521"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}