robots.txt and sitemap

← Back

The sitemap is generated automatically at /sitemap.xml, and robots.txt is edited from the admin panel at its own address.

The site map is located at /sitemap.xml and is built automatically on every request — there is no file on disk and you don't need to create one. It includes only pages with the access level "Everyone"; language versions are listed within a single entry, as Google requires. A section hidden in some language ("Sections and informers by language" on the "Site languages" tab) is not included in the map for that language.

robots.txt opens at /robots.txt: a visitor and a search robot will see the text, and you will see an editor. The same text can also be edited in the section window, via the "Module settings" button, in the "robots.txt content" field. An empty field is meaningful here: it means "build automatically", and the engine will write a sensible file with a link to the site map on its own.

The robots.txt section exists on every site, but it isn't shown in the menu — this is normal.

If it didn't work

  • Changes to robots.txt aren't visible. If a real robots.txt file lies in the site root on the server, the web server serves it and the request never reaches the engine. The file needs to be deleted.
  • The page isn't in the site map. Check the access level: everything except "Everyone" is not included in the map. Addresses with an extension and informers are not included either.
Did the article help?

See also

In the help section, you will find answers to frequently asked questions and useful instructions for working with the Site Look website builder. Here you can learn how to manage sections, add objects, and configure the website. The materials will be useful for both beginners and experienced users. If you haven't found an answer, contact support.