# https://www.robotstxt.org/robotstxt.html User-agent: * Disallow: /*?*q= Disallow: /search/new Disallow: /search?*/ Disallow: /socket.io/ Disallow: /onboarding/ Disallow: /join/ Allow: /academic Allow: /enterprise Allow: /finance Allow: /hub Allow: /podcast Allow: /pro Allow: /shopping Allow: /travel User-agent: Googlebot Disallow: /*?*q= Disallow: /search* Disallow: /search?*/ Disallow: /socket.io/ Disallow: /onboarding/ Disallow: /join/ Allow: /academic Allow: /enterprise Allow: /finance Allow: /hub Allow: /podcast Allow: /pro Allow: /shopping Allow: /travel Sitemap: https://www.perplexity.ai/sitemap.xml