|
1 |
2 |
1 |
1 |
1 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 |
| None |
| 1 | *.crawl.baidu.com | |
| 2 | *.wadax.ne.jp | |
| *.naver.jp | ||
| *.googlebot.com | ||
| *.crawl.yahoo.net |
| 1 | Mozilla/5 | |
| Baiduspider+(+http://www.baidu.com/search/spider.htm) | ||
| 3 | Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/) |
| 1 | Etc. |