Web Governance
Monsidobot
This article gives answers to some frequently asked questions about the Web Governance crawler.
Monsidobot is the name of the Web Governance web crawler. It is the tool that is used to do a scan on websites as requested by our clients as part of our offering.
This happens because one or more of our clients has links to your website on their website. We make requests to determine if the links that they have on their site are still valid.
For non-client links, the crawler attempts to make a HEAD request in order to be as resource-frugal as possible. Unfortunately, not all websites support HEAD, and so for a range of non 2XX response codes, the crawler tries to determine if the link is actually in a non-functional state or if the website does not support HEAD requests.
The request is made because we need to verify the status of the link. Unless you are a client, Acquia has no interest in the content of your website and will not save any data nor use it in any way outside of the response code for verification of the status of the link.
Additional resources
If this content did not answer your questions, try searching or contacting our support team for further assistance.
If this content did not answer your questions, try searching or contacting our support team for further assistance.
Web Governance