| Templates detected |
Robots meta tag and X-Robots-Tag HTTP header |
|---|---|
| {$templateSeo} |
|
Model:
User-agent: [the name of the robot the following rule applies to] Disallow: [the URL path you want to block] Allow: [the URL path in of a subdirectory, within a blocked parent directory, that you want to unblock]
Example:
User-agent: *
Disallow: /admin.php
Disallow: /register
Disallow: /account
Disallow: /login
Disallow: /members
Disallow: /forums
Allow: /forums/rules
Allow: /forums/library
Allow: /forums/chittalk
Allow: /forums/lightdiscussions
Sitemap: {$xenOptions.boardUrl}/sitemap.php
Prepared to become the first result on search engines?
{$robotstxt}