Robots n‡jv GKai‡bi AbjvBb mdUIq¨vi hv
search engine ¸‡jv e¨venvi K‡i Bnvi `¦viv search engine ¸‡jv Automatically I‡qemvBU ¸‡jv wfwRU K‡i,Zv‡`i content engine G indexeded Kvivi Rb¨| Robots.txt n‡jv †U·U dvBj hv Avcbvi I‡qemvf©v‡i _vK‡e| Search Engine I Rbots My‡jv Avcbvi I‡qemvBU craw Kivi c~‡e© G dvBjwU Read Ki‡e Ges GB dvBj †jLv instruction Abyhvqx KvR Ki‡Z eva¨ _vK‡e| G †U·U dvBj Øviv †h‡Kvb Online Robot †K mvBU wfwRU G Allow Ges Disallow Kiv hvq|
robots.txt
dvB‡ji instruction †hgb n‡e:
User-agent:google
Disalow:/
User-agent:BadBot
Disalow:/
GBfv‡e †bvU‡c‡W wj‡L robots.txt
bv‡g †mf K‡i I‡qe
mvf©v‡i Avc‡jvW Kiæb| Avcbvi robots.txt dvBjwUi Kvh©KvixZv mwVK wKbv Zv
Rvbvi Rb¨ wfwRU Kiæb robotstxt.org/checker.html. AviI we¯ÍvwiZ Z‡_¨i Rb¨ wfwRU
Kiæbhttp://wwwr.robotstxt.org/
খবর বিভাগঃ
অনলাইনে অর্থ উপার্জন
