Robots.txt - General Support - ProcessWire

Hey guys,. It's been a while! Any rules of thumb as to exactly what are the minimum directories that need to be made open in robots.txt so ...

Environment-specific robots.txt - General Support - ProcessWire

Is there any way with PW to do environment-specific robots.txt, i.e. to block robots from staging sites without having to manually edit ...

Custom Result

This is a custom result inserted after the second result.

Multi Sites with multi Robots.txt - Tutorials - ProcessWire

If you are running multiple sites with one PW setup you can't place multiple robots.txt files into your root. As long as all robots.txt files ...

Need help blocking a crawler - General Support - ProcessWire

I tried with robots.txt. but this crawler does not seem to respect what is configured. in robots.txt. I need something more powerfull with a ...

htaccess rewrite runs into processwire error - General Support ...

I have a site that has other ccTLDs, such as .co.za, .co.il, etc., I am trying to make a robots.txt for each of the different domains by following this article.

Hide dev site form google - General Support - ProcessWire

Use a robots.txt or the meta tags as you describe. I prefer option 1 since it's a matter of keeping everyone out except clients with an username ...

[Request] ProcessWire - Apps packaging - YunoHost Forum

What about the wonderfull ProcessWire CMS? Anybody tried to install via git clone of the official repository?

singe page site - google indexing problem - ProcessWire

Hi there,. i developed a single page site where the sections of the site are pages within processwire. For example imagine this case: I have ...

How to hide the admin (backend) login from bots and most people

I want to allow clients to login but I assume from a security POV it's better to not have a link to, say, /processwire/ in the footer as doing ...

Robots.txt Files - Search.gov

A /robots.txt file is a text file that instructs automated web bots on how to crawl and/or index a website. Web teams use them to provide information about ...