User-agent: ia_archiver Disallow: / User-agent: * Disallow: /ads/* Disallow: /my-anime Disallow: /api/* Disallow: /library/* Disallow: /settings/* Disallow: /password/* Disallow: /admin/*