So, I used the following robots.txt, but it does not seem to work.
Quote:
Disallow: /post-*.html$
Disallow: /updates-topic.html*$
Disallow: /stop-updates-topic.html*$
Disallow: /ptopic*.html$
Disallow: /ntopic*.html$
|
I really want this to work, so I am thinking about making some changes like the followings:
Quote:
Disallow: /post-*.html
Disallow: /updates-topic.html*
Disallow: /stop-updates-topic.html*
Disallow: /ptopic*.html
Disallow: /ntopic*.html
|
Quote:
Disallow: /post-*.html
Disallow: /updates-topic.html
Disallow: /stop-updates-topic.html
Disallow: /ptopic*.html
Disallow: /ntopic*.html
|
How can I get this robots.txt to work? What (minor) modifications do I need to make?
