Giúp mình làm cái file robot.txt với !!!

[Buffalo Crazy]

Giúp mình làm cái file robot.txt với !!!

Không biết vẽ đường đi cho bot làm sao , Bác nào vẽ giùm mình cái đi nha hì hì

[Mr. Ngố]

Giúp mình làm cái file robot.txt với !!!

file này chỉ có tác dụng ngăn cản bot truy cập vào những đường dẫn dãddujowjc robots chỉ định thôi bạn à.
Mình nghĩ thế ! bạn làm site về gì ! mã nguồn nào?

[Buffalo Crazy]

Giúp mình làm cái file robot.txt với !!!

Teen - Ebook - MMO kết hợp
vbb
demo: hoiquanteen.net

[Mr. Ngố]

Giúp mình làm cái file robot.txt với !!!

của mình đây.

User-Agent: *
Allow: /

sitemap: http://raovat9x.com/xmlsitemap.php

Disallow: /admincp/
Disallow: /attachments/
Disallow: /install/
Disallow: /includes/

[Aliens]

Giúp mình làm cái file robot.txt với !!!

Demo: http://zozao.net/robots.txt

[Buffalo Crazy]

Giúp mình làm cái file robot.txt với !!!

User-Agent: *
Allow: /

sitemap: http://raovat9x.com/xmlsitemap.php

Disallow: /admincp/
Disallow: /attachments/
Disallow: /install/
Disallow: /includes/

Vẽ đường cho sói

User-agent: *
sitemap: http://zozao.net/sitemap.xml
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /global.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php

sao chặn nhiều file vậy bác
----> BỔ SUNG BÀI VIẾT<----
---------------------------------------------------------------

User-agent: *
Disallow:
Sitemap: http://hoiquanteen.net/sitemap.xml

Khỏi chặn đơn giản
----> BỔ SUNG BÀI VIẾT<----
---------------------------------------------------------------

User-agent: *
Disallow: /data
Allow: /@forum/cnttvnn_register.php
Allow: /@forum/memberlist.php
Allow: /@forum/showthread.php?p=*
Allow: /@forum/forumdisplay.php?f=*
Sitemap: http://www.cnttvnn.com/@forum/sitemap_index.xml.gz

robots.txt của http://cnttvnn.com/

# Allow Archive.org to save snapshots of everything
User-agent: ia_archiver
Allow: /

# Tame yahoo... it tends to eat a ton of resources without a delay
User-agent: Slurp
Crawl-delay: 60


#list individual pages and files here that all bots should ignore, as well as group extentions.
#If you re-write everything to .html, you can disallow *.php, but note that if you don't have a CRR for custom pages, those will be blocked.

User-agent: *
Disallow: *.js
Disallow: /install/
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /images/
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /global.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php
Disallow: /f258/
Disallow: /f504/
Disallow: /f503/
Disallow: /f502/
Disallow: /f501/
Disallow: /f314/
Disallow: /f541/
Disallow: /f540/

robots.txt của http://vn-zoom.com

[boyk3n]

Giúp mình làm cái file robot.txt với !!!

cái sitemap làm sao thế

[boyk3n]

Giúp mình làm cái file robot.txt với !!!

ai chỉ mình cách là file cho bot và up vào đâu và cái site map làm sao thế ??