# robot exclusion for site User-agent: * Disallow: /dev Disallow: /res Disallow: /c/list.html Disallow: /articles