User-agent: * Disallow: /pub/site/* Disallow: /preview/* Allow: /