Change [Cloud Next] Like Cloud Classic, Cloud Next environments leverage the robots.txt file to block search engines from crawling acquia-sites.com domains.
Fix [Cloud Next] The X-Robots-Tag parameter was not present in 301 requests for acquia-sites.com domains. In addition, the robots.txt file is overridden.
Cloud Platform - May 7, 2023 | Acquia Product Documentation
Cloud Platform