Arkadaşlar Xenforo Sitem /forum/ dizininde kurulu ve ana dizinde blog kurulu wordpress tabanlı.
robots.txt dosylarını sizlere paylaşıyorum uygun ve doğruluğunu kontrol edermisiniz tecrübelerinize dayanarak.
WordPress - www.tkbilgin.com
robots.txt
XenForo - www.tkbilgin.com/forum
robots.txt
robots.txt dosylarını sizlere paylaşıyorum uygun ve doğruluğunu kontrol edermisiniz tecrübelerinize dayanarak.
WordPress - www.tkbilgin.com
robots.txt
Kod:
User-Agent: *
Allow: /wp-content/uploads/
Disallow: /wp-content/plugins/
Disallow: /readme.html
Disallow: /wp-admin/
Sitemap: https://www.tkbilgin.com/post-sitemap.xml
Sitemap: https://www.tkbilgin.com/page-sitemap.xml
Sitemap: https://www.tkbilgin.com/category-sitemap.xml
Sitemap: https://www.tkbilgin.com/forum/sitemap-1.xml
Sitemap: https://www.tkbilgin.com/forum/sitemap-2.xmlXenForo - www.tkbilgin.com/forum
robots.txt
Kod:
User-agent: Googlebot
User-agent: googlebot-image
User-agent: googlebot-mobile
User-agent: MSNBot
User-agent: Slurp
User-agent: Teoma
User-agent: Gigabot
User-agent: Robozilla
User-agent: Nutch
User-agent: ia_archiver
User-agent: baiduspider
User-agent: naverbot
User-agent: yeti
User-agent: yahoo-mmcrawler
User-agent: psbot
User-agent: yahoo-blogs/v3.9
User-agent: *
Disallow: /threads/*/reply
User-agent: *
Disallow: /whats-new/
Disallow: /account/
Disallow: /hesap/
Disallow: /members/
Disallow: /kullanicilar/
Disallow: /attachments/
Disallow: /goto/
Disallow: /posts/
Disallow: /login/
Disallow: /admin.php
Disallow: /help?*
Disallow: /yardim?*
Disallow: /search/
Disallow: /arama/
Disallow: /misc/
Disallow: /install/
Disallow: /admin.php
Disallow: /yonlendirme?*
Disallow: /yonlendirme*
Disallow: /misc/cookies*
Allow: /
Sitemap: https://www.tkbilgin.com/forum/sitemap.xml
Sitemap: https://www.tkbilgin.com/forum/sitemap-1.xml
Sitemap: https://www.tkbilgin.com/forum/sitemap-2.xml
User-agent: MJ12bot
Disallow: /
