Why do I have requests from Monsidobot?

If you are not a client and you see that there are requests from Monsidobot on your website, is is most likely because one or more of Acquia Web Governance clients has a link to your website on their website. Monsidobot makes requests to determine if the links that they have on their site are valid.

For non-client links, the Monsidobot crawler attempts to make a HEAD request in order to be as resource-frugal as possible. Unfortunately, not all websites support HEAD. When this happens and results in a range of non 2XX response codes, the crawler tries to determine if the link is actually in a non-functional state or if the website just does not support HEAD requests.