0.0.15 robots.txt add allow/disallow options

This commit is contained in:
2024-06-10 23:35:37 +03:00
parent 3a18688143
commit 8eaff8ebbc

View File

@@ -1,4 +1,6 @@
User-agent: * User-agent: *
Disallow: / Allow: /
Disallow: */articles/*
Disallow: /admin
Host: tripwb.com Host: tripwb.com