User-agent: * Disallow: *.php$ Disallow: *.asp$ Disallow: *.aspx$ Disallow: /profile/ User-agent: * Crawl-delay: 1 User-agent: GPTBot Disallow: / User-agent: AppleBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: ChatGLM-Spider Disallow: / User-agent: YisouSpider Disallow: / User-agent: * Allow: /