You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
The Robots module provides the following functionalities:
- contains a router to match application action class for requests to the
robots.txt file;
- allows obtaining the content of the
robots.txt file depending on the settings of the current website.