User-Agent: * Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /go/ Disallow: /_next/image/ Disallow: /ads.txt Disallow: /search/ User-Agent: Diffbot Disallow: / User-Agent: YandexBot Disallow: / User-Agent: Yandex Disallow: / User-Agent: YandexImages Disallow: / User-Agent: Mail.RU_Bot Disallow: / User-Agent: Baiduspider Disallow: / User-Agent: Bytespider Disallow: / User-Agent: Sogou web spider Disallow: / User-Agent: PetalBot Disallow: / User-Agent: 360Spider Disallow: / User-Agent: NaverBot Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: DotBot Disallow: / User-Agent: SemrushBot Disallow: / User-Agent: BLEXBot Disallow: / User-Agent: DataForSeoBot Disallow: / Sitemap: https://fapindex.com/sitemap.xml