Mastouille

Harald SackIn our <a href="https://sigmoid.social/tags/ISE2025" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ISE2025</a> lecture last Wednesday, we learned how in n-gram language models via Markov assumption and maximum likelihood estimation we can predict the probability of the occurrence of a word given a specific context (i.e. n words previous in the sequence of words).<a href="https://sigmoid.social/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NLP</a> <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lecture</a> <a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fizise</a> @tabea <a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@enorouzi</a> <a href="https://fedihum.org/@sourisnumerique" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@sourisnumerique</a> <a href="https://wisskomm.social/@fiz_karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fiz_karlsruhe</a> <a href="https://mastodon.social/@KIT_Karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@KIT_Karlsruhe</a>

EPFL🧠 🤖 Researchers from the Natural Language Processing Laboratory and NeuroAI Laboratory have discovered key ‘units’ in large AI models that seem to be important for language, mirroring the brain’s language system. When these specific units were turned off, the models got much worse at language tasks.<a href="https://social.epfl.ch/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a> <a href="https://social.epfl.ch/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ArtificialIntelligence</a> <a href="https://social.epfl.ch/tags/AIResearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AIResearch</a> Read more: <a href="https://go.epfl.ch/LJx-en" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://go.epfl.ch/LJx-en</a>

Harald SackBuilding on the 90s, statistical n-gram language models, trained on vast text collections, became the backbone of NLP research. They fueled advancements in nearly all NLP techniques of the era, laying the groundwork for today's AI. F. Jelinek (1997), Statistical Methods for Speech Recognition, MIT Press, Cambridge, MA<a href="https://sigmoid.social/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NLP</a> <a href="https://sigmoid.social/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a> <a href="https://sigmoid.social/tags/HistoryOfAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HistoryOfAI</a> <a href="https://sigmoid.social/tags/TextProcessing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#TextProcessing</a> <a href="https://sigmoid.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://sigmoid.social/tags/historyofscience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#historyofscience</a> <a href="https://sigmoid.social/tags/ISE2025" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ISE2025</a> <a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fizise</a> <a href="https://wisskomm.social/@fiz_karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fiz_karlsruhe</a> <a href="https://fedihum.org/@tabea" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@tabea</a> <a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@enorouzi</a> <a href="https://fedihum.org/@sourisnumerique" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@sourisnumerique</a>

Erika Varis DoggettAt <a href="https://mas.to/tags/NAACL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NAACL</a> this week and I’m delighted to see the name change to “Nations of the Americas” as well as the special theme for this year of multi- and cross-culturalism in <a href="https://mas.to/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NLP</a>. <a href="https://mas.to/tags/NLProc" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NLProc</a> <a href="https://mas.to/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mas.to/tags/LLMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLMs</a> <a href="https://mas.to/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a> <a href="https://mas.to/tags/CompLing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CompLing</a> <a href="https://mas.to/tags/ComputationalLinguistics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ComputationalLinguistics</a>

Harald SackToday, the 2nd lecture of <a href="https://sigmoid.social/tags/ISE2025" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ISE2025</a> took place with an introduction into Natural Language Processing, which will be subject of our lecture for the next 4 weeks.<a href="https://sigmoid.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://sigmoid.social/tags/nlp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nlp</a> <a href="https://sigmoid.social/tags/informationextraction" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#informationextraction</a> <a href="https://sigmoid.social/tags/ocr" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ocr</a> <a href="https://sigmoid.social/tags/ner" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ner</a> <a href="https://sigmoid.social/tags/linguistics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#linguistics</a> <a href="https://sigmoid.social/tags/computationallinguistics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#computationallinguistics</a> <a href="https://sigmoid.social/tags/morphology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#morphology</a> <a href="https://sigmoid.social/tags/pos" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#pos</a> <a href="https://sigmoid.social/tags/ambiguity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ambiguity</a> <a href="https://sigmoid.social/tags/language" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#language</a> <a href="https://wisskomm.social/@fiz_karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fiz_karlsruhe</a> <a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fizise</a> <a href="https://fedihum.org/@tabea" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@tabea</a> <a href="https://sigmoid.social/@enorouzi" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@enorouzi</a> <a href="https://fedihum.org/@sourisnumerique" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@sourisnumerique</a> <a href="https://sigmoid.social/tags/AIart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AIart</a> <a href="https://sigmoid.social/tags/generativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#generativeAI</a> <a href="https://sigmoid.social/tags/machinetranslation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#machinetranslation</a> <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a>

Marco Siccardi💻 Apple is taking #privacy seriously- also for training their #AI #languageModels. In this new blog post, the #ML team outlines how they plan to get synthetic training #data without compromising privacy <a href="https://machinelearning.apple.com/research/differential-privacy-aggregate-trends" rel="nofollow noopener noreferrer" target="_blank">machinelearning.apple.com/research/…</a>

Bruce Sterling @bruces*Machine translation efforts circa 1960. <a href="https://mastodon.social/tags/network" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#network</a> <a href="https://mastodon.social/tags/cybernetics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cybernetics</a> <a href="https://mastodon.social/tags/primevalAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#primevalAI</a> <a href="https://mastodon.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a>

isws🔥 Deadline for applications for <a href="https://sigmoid.social/tags/ISWS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ISWS</a> 2024, the International <a href="https://sigmoid.social/tags/SemanticWeb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SemanticWeb</a> Research Summer School 2024, is approaching (March 15, 2024). If your research interest includes working with semantic technologies, knowledge graphs, ontologies, and generative AI, don't hesitate and apply! We can't wait to meet all students in Bertinoro working on these awesome topics <a href="https://2024.semanticwebschool.org/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://2024.semanticwebschool.org/</a> <a href="https://sigmoid.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://sigmoid.social/tags/KnowledgeGraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#KnowledgeGraphs</a> <a href="https://sigmoid.social/tags/generativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#generativeAI</a> <a href="https://sigmoid.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLMs</a> <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> <a href="https://sigmoid.social/tags/ontologies" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ontologies</a> <a href="https://sigmoid.social/tags/dh" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dh</a> <a href="https://sigmoid.social/tags/dhd2024" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dhd2024</a> <a href="https://sigmoid.social/tags/culturalheritage" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#culturalheritage</a>

David ColarussoI find this project, based on the LegalBench dataset,¹ which aims to benchmark LLMs on legal reasoning tasks interesting. <a href="https://www.vals.ai/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.vals.ai/</a> TL:DR: Curious about which language models perform best on legal reasoning tasks? The latest evaluation reveals that Open AI's GPT-4 takes the lead, followed closely by Google's Gemini Pro. _____ ¹ <a href="https://hazyresearch.stanford.edu/legalbench/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://hazyresearch.stanford.edu/legalbench/</a><a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.social/tags/LegalTech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LegalTech</a> <a href="https://mastodon.social/tags/languageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languageModels</a>

Harald SackA typology of LLM’s capabilities and best performing open-LLMs. White boxes denote domains, blue boxes represent specific datasets and orange boxes denote open-sourced LLMs. From Chen et al., ChatGPT’s One-year Anniversary: Are Open-Source Large Language Models Catching up? <a href="https://arxiv.org/abs/2311.16989" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arxiv.org/abs/2311.16989</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a> <a href="https://sigmoid.social/tags/llms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llms</a> <a href="https://sigmoid.social/tags/gpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gpt</a> <a href="https://sigmoid.social/tags/llama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llama</a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> <a href="https://sigmoid.social/tags/opensource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#opensource</a>

natadimouOur poster at the <a href="https://mastodon.social/tags/SemTab" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SemTab</a> challenge corner is ready & Duo Yang will explain all spicy details of our solution which combines <a href="https://mastodon.social/tags/heuristics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#heuristics</a> & <a href="https://mastodon.social/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a> to understand entities, types & relationships of tables with very promising results! <a href="https://mastodon.social/tags/iswc2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#iswc2023</a>

Andrew LampinenVery excited to share a substantially updated version of our preprint “Language models show human-like content effects on reasoning tasks!” TL;DR: LMs and humans show strikingly similar patterns in how the content of a logic problem affects their answers. Thread: 1/10 <a href="https://sigmoid.social/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a> <a href="https://sigmoid.social/tags/lms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lms</a> <a href="https://sigmoid.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://sigmoid.social/tags/cogsci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cogsci</a> <a href="https://sigmoid.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#machinelearning</a> <a href="https://sigmoid.social/tags/nlp" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nlp</a> <a href="https://sigmoid.social/tags/nlproc" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#nlproc</a> <a href="https://sigmoid.social/tags/cognitivescience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cognitivescience</a>

Nextcloud 📱☁️💻😲Did you know compliments can influence large-language models?They're even open to Argentinian Spanish & Swiss German slang. Discover how Nextcloud AI is tackling ethical concerns differently: <a href="https://mastodon.xyz/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.xyz/tags/EthicalAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#EthicalAI</a> <a href="https://mastodon.xyz/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a> <a href="https://nextcloud.com/blog/nextcloud-ethical-ai-rating/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://nextcloud.com/blog/nextcloud-ethical-ai-rating/</a>

Harald SackMany new and interesting topics in our upcoming <a href="https://sigmoid.social/tags/KnowledgeGraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#KnowledgeGraphs</a> - Foundations and Applications online lecture at <a href="https://sigmoid.social/tags/openhpi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#openhpi</a> - knowledge representation with graphs - <a href="https://sigmoid.social/tags/RDF" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RDF</a> & RDFS - Querying RDF with <a href="https://sigmoid.social/tags/SPARQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SPARQL</a> & <a href="https://sigmoid.social/tags/SHACL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SHACL</a> - <a href="https://sigmoid.social/tags/OWL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OWL</a> & Description Logics - ontological engineering - knowledge graph <a href="https://sigmoid.social/tags/embeddings" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#embeddings</a> - large <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a> Free registration open: <a href="https://open.hpi.de/courses/knowledgegraphs2023" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://open.hpi.de/courses/knowledgegraphs2023</a> <a href="https://fedihum.org/@tabea" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@tabea</a> <a href="https://fedihum.org/@sashabruns" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@sashabruns</a> <a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fizise</a> <a href="https://sigmoid.social/tags/mooc" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mooc</a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lecture</a>

Harald SackIn only 8 days our new online <a href="https://sigmoid.social/tags/MOOC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MOOC</a> course Knowledge Graphs - Foundations and Applications is going to lift off. Free registration is still open! Please spread the word! <a href="https://open.hpi.de/courses/knowledgegraphs2023" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://open.hpi.de/courses/knowledgegraphs2023</a> <a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fizise</a> <a href="https://fedihum.org/@tabea" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@tabea</a> <a href="https://fedihum.org/@sashabruns" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@sashabruns</a> <a href="https://sigmoid.social/tags/knowledgegraphs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#knowledgegraphs</a> <a href="https://sigmoid.social/tags/semanticweb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#semanticweb</a> <a href="https://sigmoid.social/tags/linkeddata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#linkeddata</a> <a href="https://sigmoid.social/tags/lod" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lod</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a> <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> <a href="https://hpi.social/@Hasso_Plattner_Institute" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@Hasso_Plattner_Institute</a> <a href="https://mastodon.social/@KIT_Karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@KIT_Karlsruhe</a> <a href="https://sigmoid.social/tags/explainableAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#explainableAI</a> <a href="https://sigmoid.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lecture</a>

Harald SackFinally, The Time Traveler’s Guide to <a href="https://sigmoid.social/tags/SemanticWeb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SemanticWeb</a> Research: Analyzing Fictitious Research Themes in the ESWC „Next 20 Years“ Track has been published by Heiko Paulheim (still not present in the <a href="https://sigmoid.social/tags/fediverse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#fediverse</a> ) and Irene Celino <a href="https://arxiv.org/abs/2309.13939" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://arxiv.org/abs/2309.13939</a> <a href="https://sigmoid.social/tags/knowledgegraph" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#knowledgegraph</a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://sigmoid.social/tags/ontology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ontology</a> <a href="https://sigmoid.social/tags/ontologies" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ontologies</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a> <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> <a href="https://sigmoid.social/tags/robot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#robot</a>

Mark GardnerI keep thinking of this bit from <a href="https://social.sdf.org/tags/Idiocracy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Idiocracy</a> as people keep adding “<a href="https://social.sdf.org/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ArtificialIntelligence</a>” to stuff: <a href="https://www.youtube.com/watch?v=kAqIJZeeXEc" rel="nofollow noopener noreferrer" target="_blank">https://www.youtube.com/watch?v=kAqIJZeeXEc</a>“<a href="https://social.sdf.org/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ChatGPT</a> has what minds crave! It has <a href="https://social.sdf.org/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a>!”“<a href="https://social.sdf.org/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a>" <a href="https://social.sdf.org/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a> <a href="https://social.sdf.org/tags/OpenAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenAI</a> <a href="https://social.sdf.org/tags/Bing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Bing</a> <a href="https://social.sdf.org/tags/Bard" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Bard</a>

Harald SackLast leg in our brief <a href="https://sigmoid.social/tags/timeline" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#timeline</a> of (Large) <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> (so far) is 2023, which saw the advent of many new and updated <a href="https://sigmoid.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLMs</a>: - BARD <a href="https://sigmoid.social/tags/chatbot" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#chatbot</a> is introduced by Google - LLaMA is introduced by Meta - GPT-4 is introduced by OpenAI. - LLaMA2.0 is introduced by Meta - and many others... <a href="https://sigmoid.social/tags/ISE2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ISE2023</a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lecture</a> slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank">https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</a> GPT-4 tech report: <a href="https://arxiv.org/pdf/2303.08774" rel="nofollow noopener noreferrer" target="_blank">https://arxiv.org/pdf/2303.08774</a> <a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fizise</a> <a href="https://mastodon.social/@KIT_Karlsruhe" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@KIT_Karlsruhe</a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#artificialintelligence</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a> <a href="https://sigmoid.social/tags/llms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llms</a> <a href="https://sigmoid.social/tags/gpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gpt</a> <a href="https://sigmoid.social/tags/openai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#openai</a> <a href="https://sigmoid.social/tags/llama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llama</a> <a href="https://sigmoid.social/tags/lamda" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lamda</a> <a href="https://sigmoid.social/tags/bard" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#bard</a>

Harald SackNext stop on our brief <a href="https://sigmoid.social/tags/timeline" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#timeline</a> of (Large) <a href="https://sigmoid.social/tags/LanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LanguageModels</a> is 2022: InstructGPT is introduced by OpenAI, a GPT-3 model complemented and fine-tuned with reinforcement learning from human feedback. ChatGPT is introduced by OpenAI as a combination of GPT-3, Codex, and InstructGPT including lots of additional engineering. <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ise2023</a> lecture slides: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank">https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</a> <a href="https://sigmoid.social/tags/RLHF" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RLHF</a> explained: <a href="https://huggingface.co/blog/rlhf" rel="nofollow noopener noreferrer" target="_blank">https://huggingface.co/blog/rlhf</a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://sigmoid.social/tags/creativeai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#creativeai</a> <a href="https://sigmoid.social/tags/rlhf" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#rlhf</a> <a href="https://sigmoid.social/tags/gpt3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gpt3</a> <a href="https://sigmoid.social/tags/gpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gpt</a> <a href="https://sigmoid.social/tags/openai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#openai</a> <a href="https://sigmoid.social/tags/chatgpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#chatgpt</a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lecture</a> <a href="https://sigmoid.social/tags/artificialintelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#artificialintelligence</a> <a href="https://sigmoid.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#llm</a>

Harald SackNext stop in our brief <a href="https://sigmoid.social/tags/timeline" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#timeline</a> of (large) <a href="https://sigmoid.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#languagemodels</a> is 2021: DALL-E is released by OpenAI and raises text2img to a new level. Codex is released by OpenAI able to translate natural language into programming code. WebGPT is released by OpenAI for answering open-ended questions. LaMDA is introduced by Google. Slides from <a href="https://sigmoid.social/tags/ise2023" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ise2023</a> <a href="https://sigmoid.social/tags/lecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lecture</a>: <a href="https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link" rel="nofollow noopener noreferrer" target="_blank">https://drive.google.com/file/d/1atNvMYNkeKDwXP3olHXzloa09S5pzjXb/view?usp=drive_link</a> Codex paper: <a href="https://arxiv.org/abs/2107.03374" rel="nofollow noopener noreferrer" target="_blank">https://arxiv.org/abs/2107.03374</a> DALL-E paper: <a href="https://arxiv.org/abs/2102.12092" rel="nofollow noopener noreferrer" target="_blank">https://arxiv.org/abs/2102.12092</a> <a href="https://sigmoid.social/@fizise" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@fizise</a> <a href="https://sigmoid.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ai</a> <a href="https://sigmoid.social/tags/generativeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#generativeAI</a> <a href="https://sigmoid.social/tags/GPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#GPT</a> <a href="https://sigmoid.social/tags/dalle" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dalle</a> <a href="https://sigmoid.social/tags/openai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#openai</a> <a href="https://sigmoid.social/tags/lamda" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#lamda</a>

Recherches récentes

Options de recherche

Administré par :

Statistiques du serveur :

#languagemodels