娴缃绔Robots璇浣跨

姣釜浜洪芥繁绉锛姣釜缃绔涔芥绉锛浜哄灏绉ㄥ搴锛缃绔浠ョrobots杩琛灞斤璁╁汉涓浜锛璁╄娉锛灏＄娴涓Robots璇SEO涓濡瀵规版村ソ瑙ｅ锛浠涔Robots锛

Robots锛涔绉颁负哄ㄤ汉绛锛害涓绉绱㈠杩涓绉绋搴robot锛绉spider锛锛ㄨ缃涓缃椤靛苟缃椤典俊ㄥ浠ュㄦㄧ缃绔涓寤轰涓函浠robots.txt锛缃绔杩Robots璇绱㈠椤甸㈠浠ユ锛椤甸芥

Robots.txt浣1灞界绔姝婚炬2灞芥绱㈠绔瑰澶瀹瑰椤甸3绘绱㈠储寮缃绔绉х瀹广锛渚濡ㄦ疯处蜂俊锛

Robots.txt惧ㄥrobots.txt  浠跺璇ユ剧疆ㄧ绔圭涓锛/robots.txt锛涓句ヨ锛褰spider璁块涓绔锛姣濡http://www.chdseo.com锛讹棣浼妫ヨ缃绔涓robots.txt杩涓浠讹濡 Spider惧拌涓浠讹瀹灏变规涓浠跺瀹圭瑙锛ョ‘瀹瀹璁块淬Robots娉Robots涓变涓涓や釜绗缁锛涓汉姹瑙濂芥т寰涓椤哄锛卞璺佃椤哄奖涓澶э涓涓娈碉璁板:㈠绌烘硷User-agent: ㄦ蜂唬   Disallow:  涓璁Allow:  璁      锛/ 浠ｈ〃圭锛濡 Allow: /  璁告锛涓や釜绗 * 浠ｈ〃0-9 A-Z #绗 $ 浠ユ涓

蜂ㄦ锛

渚1. 绂姝㈡绱㈠绔浠讳ㄥ

User-agent: *

Disallow: /

渚2. 璁告robot璁块

(涔浠ュ缓涓涓┖浠 "/robots.txt")

User-agent: *

Disallow:

User-agent: *

Allow: /

渚3. 浠绂姝Baiduspider璁块ㄧ缃绔

User-agent: Baiduspider

Disallow: /

绂姝㈣/cgi-bin/涓浠".htm"涓哄URL()

User-agent: *

Disallow: /cgi-bin/*.htm$

渚4.绂姝Baiduspider缃绔涓剧锛浠璁告缃椤碉绂姝㈡浠讳剧

User-agent: Baiduspider

Disallow: .jpg$

Disallow: .jpeg$

Disallow: .gif$

Disallow: .png$

Disallow: .bmp$

渚5.浠璁Baiduspider璁块ㄧ缃绔

User-agent: Baiduspider

Disallow:

User-agent: *

Disallow: /

渚6.璁歌瑰涓ㄥurl锛规繁姹瀹涔锛

User-agent: *

Allow: /cgi-bin/see

Allow: /tmp/hi

Allow: /~joe/look

Disallow: /cgi-bin/

渚7.涓璁asp

User-agent: *

Disallow: /*.asp