# Robots.txt file from https://www.aigrammar.com/ # All robots will spider the domain User-agent: * Allow:/