Créer un compteSe connecter

Recherches récentes

Aucune recherche récente

Options de recherche

Disponible uniquement lorsque vous êtes connecté.
mastouille.fr est l'un des nombreux serveurs Mastodon indépendants que vous pouvez utiliser pour participer au fédiverse.
Mastouille est une instance Mastodon durable, ouverte, et hébergée en France.

Administré par :

Statistiques du serveur :

582
comptes actifs

mastouille.fr: À proposAnnuaire des profilsPolitique de confidentialité

Mastodon: À proposTélécharger l’applicationRaccourcis clavierVoir le code sourcev4.3.4

#robotsdottxt

0 message0 participant0 message aujourd’hui
@reiver ⊼ (Charles) :batman:<p>The Web has been voluntarily opt-out since the early to mid- 1990s.</p><p>Before that, there was no opt-ing out.</p><p>The act of putting something onto the (open) Web was (and still is) understood as consent for others to use your data.</p><p>This is the norm of the Web — and has been for decades.</p><p>I think it is unlikely this norm is going to change any time soon.</p><p><a href="https://mastodon.social/tags/Fediverse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Fediverse</span></a> <a href="https://mastodon.social/tags/OptOut" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OptOut</span></a> <a href="https://mastodon.social/tags/RobotsDotTXT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RobotsDotTXT</span></a> <a href="https://mastodon.social/tags/RobotsNotWantedDotTXT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RobotsNotWantedDotTXT</span></a> <a href="https://mastodon.social/tags/WorldWideWeb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>WorldWideWeb</span></a></p>
Chris is.<p>If you run a website and you think that adding anything to robots.txt "blocks" <a href="https://wandering.shop/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ChatGPT</span></a> or any other <a href="https://wandering.shop/tags/WebCrawler" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>WebCrawler</span></a> from accessing your site, you may want to think that process through a bit more.</p><p><a href="https://wandering.shop/tags/RobotsDotTxt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RobotsDotTxt</span></a> is *asking nicely* for the robot not to look places. If you don't trust the ethics of the scanning party, I'm not sure why you would think that asking them nicely not to mine your free content for their profit would even slow them down.</p>
ExplorerFlux en direct
À propos