wikiless/static/robots.txt at 859eae8ff8cfcabecdfa0a4f9bfad3a911d7a599 - wikiless - Gitea: Git with a cup of darkness

Metastem/wikiless

mirror of https://github.com/Metastem/wikiless synced 2024-12-06 19:16:58 +01:00

Files

T

Eloy Degen 57e1395a26 Add robots.txt which only allows indexing the homepage, so it won't traverse the whole wiki

2022-09-10 00:17:44 +02:00

3 lines

35 B

Plaintext

Raw Blame History

	`user-agent: *`
	`Allow: /$`
	`Disallow: /`