User-agent: * Disallow: /external_auth/ Disallow: /urls.js Disallow: /api/ Disallow: