Mastouille

2 messages2 participants1 message aujourd’hui

Lyrical Garfield 🎶 :garfield:<a href="https://masto.ai/tags/Garfield" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Garfield</a> <a href="https://masto.ai/tags/music" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#music</a> <a href="https://masto.ai/tags/Crawling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Crawling</a> <a href="https://masto.ai/tags/bot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#bot</a> <a href="https://masto.ai/tags/lyrics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lyrics</a>

Max ResingAlso <a href="https://infosec.exchange/tags/Wikimedia" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Wikimedia</a> complaints about the constant surge in <a href="https://infosec.exchange/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a> <a href="https://infosec.exchange/tags/crawling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#crawling</a>. It is a strain to the free project of <a href="https://infosec.exchange/tags/Wikipedia" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Wikipedia</a> and such. For my MSc thesis, I fetched wikipedia <a href="https://infosec.exchange/tags/archives" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#archives</a> which they regularly snapshot and hand out for free.Is this resource simply ignored, because it would cause additional processing effort next to the anyway running <a href="https://infosec.exchange/tags/webcrawlers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#webcrawlers</a>? <a href="https://wikimedia.social/@wikimediafoundation" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@wikimediafoundation</a> , can you briefly comment on whether or not you have numbers on LLM companies that turn to archives, instead of crawling?

Daniel 黄法官 CyReVolt 🐢<a href="https://youtu.be/NCI-hV7OZWo" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://youtu.be/NCI-hV7OZWo</a>on <a href="https://mastodon.social/tags/Cloudflare" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cloudflare</a>'s offer to <a href="https://mastodon.social/tags/charge" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#charge</a> for <a href="https://mastodon.social/tags/crawling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#crawling</a>The next step would be to have fine granular access <a href="https://mastodon.social/tags/key" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#key</a> stores based on OS mechanisms. Imagine thousands of tokens paired with URLs that the <a href="https://mastodon.social/tags/browser" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#browser</a> (or any HTTP client) can load to gain access to resources. And if backed by cloud stuff, sharing the tokens between laptops and phones also becomes possible, just like current password managers do it. That's effectively <a href="https://mastodon.social/tags/DRM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DRM</a> all over the place then, but more convenient.

Barry SchwartzGoogle's AI crawler for Gemini, Google-Extended, does render JavaScript using the shared Web Rendering Service <a href="https://bird.makeup/users/g33konaut" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@g33konaut</a> confirmed to <a href="https://mastodon.social/@suzukik" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@suzukik</a> <a href="https://www.seroundtable.com/googles-ai-crawler-renders-javascript-39353.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.seroundtable.com/googles-ai-crawler-renders-javascript-39353.html</a> hat tip <a href="https://mas.to/@glenngabe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@glenngabe</a> <a href="https://c.im/tags/google" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#google</a> <a href="https://c.im/tags/gemini" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gemini</a> <a href="https://c.im/tags/googleai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#googleai</a> <a href="https://c.im/tags/rendering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#rendering</a> <a href="https://c.im/tags/seo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#seo</a> <a href="https://c.im/tags/crawling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#crawling</a> <a href="https://c.im/tags/indexing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#indexing</a> <a href="https://c.im/tags/seo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#seo</a> <a href="https://c.im/tags/googlebot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#googlebot</a> <a href="https://c.im/tags/google" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#google</a>-extended

Recherches récentes

Options de recherche

Administré par :

Statistiques du serveur :

#crawling