WEDOS WebSite – Robots meta tags

  WebSite

WEDOS WebSite editor does not support robots.txt files. Anyway, you can insert the required rules in Nastavení stránky (Page settings) as Header, using a <meta> tag. Meta tags are set for each page, so you can restrict indexing only for chosen pages. There is no need to allow indexing, that is the default behavior.

In the WEDOS WebSite editor, there is Nastavení stránky (Page settings) section. Rules will be valid only for the page.

Don’t forget to save (Uložit nyní) and publish changes (Zveřejnit web).

You can check your settings in a Chrome extension: Robots Exclusion Checker.

Search engine rules

Check the official Google manual. There is no need to allow indexing since it’s the default behavior. As there is a link to your website on the internet, the robot will sooner or later find it.

Robots meta tags are there as a wish not to index your webpage. Usually in case of development and restricted or temporary content. Respecting the rules is only up to the robot’s settings. The most important robots usually do respect it.

  • If your webpage should not be indexed, use this meta tag:
<meta name="robots" content="noindex, nofollow" />
  • If you wish to restrict only a specific robot, you can use this meta tag:
<meta name="AdsBot-Google" content="noindex" />