User-agent: * Allow: / Allow: /assets/*.js Allow: /assets/*.css Disallow: /admin/ Disallow: /login Disallow: /search Disallow: /private/ Disallow: /api/ Disallow: *? Disallow: /sitemap.xml