User-agent: * Allow: /index.php Disallow: /backend/* Disallow: /docs/* Disallow : *.pdf Disallow : *.xls Disallow : *.doc Disallow : *.jpg Disallow : *.xlsx Disallow : *.docx Disallow : *.png