Answered: What is the best robots.txt for SEO ?

Post date: 2020-05-26 20:03:01
Views: 102

User-agent: *

Disallow: /*/login

Disallow: /*?qa-rewrite=*

Disallow: /*/forgot

Disallow: /*/register

Disallow: /*/questions/*?sort=views&start=*

Disallow: /*/questions?sort

Disallow: /*/chat

Disallow: /*/activity/*

Disallow: /*/cdn-cgi/*

Disallow: /*/questions?start=*

Disallow: /*/questions?sort=*

Disallow: /*/search?q=*

Disallow: /search/*

Disallow: /?s=*

Disallow: /search/?query=*

Disallow: /ip/*

Disallow: /login

Disallow: /ask

Disallow: /forgot

Disallow: /register

Disallow: /admin

Disallow: /feed

Disallow: /tag

Disallow: /tags

Disallow: /users

Disallow: /user

Disallow: /message/

# allow google image bot to search all images

User-agent: Googlebot-Image

Allow: /*

Sitemap: https://yourdomain.com/sitemap.xml

correct me if I am wrong and what should else I add ? 

Please click Here to read the full story.
 
Other Top and Latest Questions:
Hazbin Hotel: Welcome to Heaven
Visit to Cluj - time-limited edition
Resident Alien: Avian Flu
Delicious in Dungeon: Stewed Cabbage/Orcs
Hazbin Hotel: Hello Rosie
FEUD: Hats, Gloves and Effete Homosexuals
Frieren: Beyond Journey's End: Frieren The Slayer
Tickets for Candidates Tournament
Safest ticket marketplace in the UK?
Looking for biology/naturalist educational tour kind of experiences.