robots txtdosyası arama motoru örümceklerinin gereksiz yerlerde dolaşmasını engellemekiçin kullanılır böylece botlar konu ve kategorilere odaklanır
Not: alltaki site uzantısını kendi sitenize göre düzenleyin ana dizineatın
PHP- Kodu:
User-agent: *
allow: /
Disallow: /?ref=
Disallow: /admincp/
Disallow: /ajaxphp
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /images/
Disallow: /includes/
Disallow: /install/
Disallow: /subscriptions/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /announcementphp
Disallow: /attachmentphp
Disallow: /calendarphp
Disallow: /cronphp
Disallow: /editpostphp
Disallow: /faqphp
Disallow: /imagephp
Disallow: /inlinemodphp
Disallow: /joinrequestsphp
Disallow: /loginphp
Disallow: /memberlistphp
Disallow: /miscphp
Disallow: /moderatorphp
Disallow: /newattachmentphp
Disallow: /newreplyphp
Disallow: /newthreadphp
Disallow: /onlinephp
Disallow: /payment_gatewayphp
Disallow: /paymentsphp
Disallow: /pollphp
Disallow: /postingsphp
Disallow: /private php
Disallow: /profilephp
Disallow: /registerphp
Disallow: /reportphp
Disallow: /reputationphp
Disallow: /searchphp
Disallow: /sendmessagephp
Disallow: /showgroupsphp
Disallow: /showpostphp
Disallow: /subscriptionphp
Disallow: /usercpphp
Disallow: /threadratephp
Disallow: /usernotephp
Disallow: /member_inlinemodphp
Disallow: /threadtagphp
Disallow: /archieve/
Disallow: /helpcenter/
Disallow: /ajaxphp
Disallow: /conversephp
Disallow: /global php
Disallow: /helpcenterphp
Disallow: /archive/
Disallow: /calendarphp
Disallow: /memberphp?
Disallow: /announcementphp
Sitemap: http://www siteadı com/sitemap_index xml gz
Not: alltaki site uzantısını kendi sitenize göre düzenleyin ana dizineatın
PHP- Kodu:
User-agent: *
allow: /
Disallow: /?ref=
Disallow: /admincp/
Disallow: /ajaxphp
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /images/
Disallow: /includes/
Disallow: /install/
Disallow: /subscriptions/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /announcementphp
Disallow: /attachmentphp
Disallow: /calendarphp
Disallow: /cronphp
Disallow: /editpostphp
Disallow: /faqphp
Disallow: /imagephp
Disallow: /inlinemodphp
Disallow: /joinrequestsphp
Disallow: /loginphp
Disallow: /memberlistphp
Disallow: /miscphp
Disallow: /moderatorphp
Disallow: /newattachmentphp
Disallow: /newreplyphp
Disallow: /newthreadphp
Disallow: /onlinephp
Disallow: /payment_gatewayphp
Disallow: /paymentsphp
Disallow: /pollphp
Disallow: /postingsphp
Disallow: /private php
Disallow: /profilephp
Disallow: /registerphp
Disallow: /reportphp
Disallow: /reputationphp
Disallow: /searchphp
Disallow: /sendmessagephp
Disallow: /showgroupsphp
Disallow: /showpostphp
Disallow: /subscriptionphp
Disallow: /usercpphp
Disallow: /threadratephp
Disallow: /usernotephp
Disallow: /member_inlinemodphp
Disallow: /threadtagphp
Disallow: /archieve/
Disallow: /helpcenter/
Disallow: /ajaxphp
Disallow: /conversephp
Disallow: /global php
Disallow: /helpcenterphp
Disallow: /archive/
Disallow: /calendarphp
Disallow: /memberphp?
Disallow: /announcementphp
Sitemap: http://www siteadı com/sitemap_index xml gz