User-agent: * Disallow: /checkout/ Disallow: /admin/ Disallow: /portal/ Disallow: /api/