User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /article.html Disallow: /terms.html Disallow: /sign-up.html/ Disallow: /log-in.html