mastouille.fr est l'un des nombreux serveurs Mastodon indépendants que vous pouvez utiliser pour participer au fédiverse.
Mastouille est une instance Mastodon durable, ouverte, et hébergée en France.

Administré par :

Statistiques du serveur :

620
comptes actifs

#foundationmodels

0 message0 participant0 message aujourd’hui

#wwdc25 #FoundationModels #Xcode #LLM

Has anyone seen the Foundation Models actually working? Am I holding it wrong? I am not getting any responses either in the playground or app, and there is a bunch of this crap in the console when running the app.

Running Xcode 26 beta on macOS 26 beta.

Are there regional restrictions? Xcode AI chat also is “unavailable in my region”.

Can time series (TS) #FoundationModels (FM) like Chronos zero-shot generalize to unseen #DynamicalSystems (DS)? #AI

No, they cannot!

But *DynaMix* can, the first TS/DS foundation model based on principles of DS reconstruction, capturing the long-term evolution of out-of-domain DS: arxiv.org/pdf/2505.13192v1

Unlike TS foundation models, DynaMix exhibits #ZeroShotLearning of long-term stats of unseen DS, incl. attractor geometry & power spectrum, w/o *any* re-training, just from a context signal.
It does so with only 0.1% of the parameters of Chronos & 10x faster inference times than the closest competitor.

It often even outperforms TS FMs on forecasting diverse empirical time series, like weather, traffic, or medical data, typically used to train TS FMs.
This is surprising, cos DynaMix’ training corpus consists *solely* of simulated limit cycles & chaotic systems, no empirical data at all!

And no, it’s neither based on Transformers nor Mamba – it’s a new type of mixture-of-experts architecture based on the recently introduced AL-RNN (proceedings.neurips.cc/paper_f), specifically trained for DS reconstruction.

Remarkably, DynaMix not only generalizes zero-shot to novel DS, but it can even generalize to new initial conditions and regions of state space not covered by the in-context information.

We dive a bit into the reasons why current time series FMs not trained for DS reconstruction fail, and conclude that a DS perspective on time series forecasting & models may help to advance the #TimeSeriesAnalysis field.

A répondu dans un fil de discussion

@Techmeme This is the danger of closed source

These are knowledge models, and they only output what they are fed with

And no, they won’t magically develop ’reasoning skills’ and be able to sift through propaganda. NOT when it’s part of the training

To think otherwise means you don’t know shit how they work

They obey statistics. Training data for #ai #foundationmodels should be subject to public #academic scrutiny. Otherwise the models are bound to fall for flooding attacks

#GenerativeAI, #FoundationModels, #LLMs, and all of that hokey nonsense shall not appear in my #robotics roadmaps as anything other than a neat research item until it can demonstrate a feasible path to #FunctionalSafety or mathematical completeness.

I lead #Product on the largest mobile-#robotic fleet known to humankind. I will not entrust decisions that could maim or kill to a pile of nondeterminate math prone to “hallucinations” or confabulation.

Cool cool I'm on holiday and Stanford releases a transparency index preprint that looks genuinely useful but also not unlike something we did months ago. I don't want to deal with this right now and it is entirely possible they haven't seen our work yet but I do wish somebody told them there's no shame in informing oneself of prior work and no cost in recognising others' efforts

#foundationmodels

Our published ACM paper (right): doi.org/10.1145/3571884.360431
(PDF pure.mpg.de/rest/items/item_35 )

Good morning everyone! Here's my latest #Connections #Introduction #Introductions #TwitterMigration post, where I curate interesting accounts for you to follow from across the #Fediverse :fediverse:

@maryrobinette is a #writer #author, and I am listening to her incredible #LadyAstronaut series at the moment. If you love #SciFi (esp hard scifi) you should read it, too! 🇺🇸

@sayashk is a #ComputerScience #PhD candidate at #Princeton, who is researching failures in #ML (he's also co-running a workshop on open #FoundationModels in about 15 hours, see my previous posts for more info) 🇺🇸

@michcampbell is Dr Micha Campbell and she is a #PalaeoClimate #PostDoc living on #Dharawal country 🇦🇺

@mthv is a #Research #Engineer who works in #GIS at #CNRS 🇫🇷

@astrolori is Lori and she is into #OpenSource, #fashion, #space and #tech #WomenInSTEM 🇨🇦

@pandas_dev is the official account for #pandas, the #Python #DataAnalysis tool 🐍 📊

@jessie is a lover of #languages and helps run #CommonVoice, @mozilla 's open #voice #data set, which now supports over 100 languages. She also teaches #WebDev and loves #hiking. She's awesome you should follow her 🇬🇧

That's all for now, please do share your own lists so we can create deeper connections, and a tightly-connected community here

I'm reminded here of @maryrobinette's short story - "Red Rockets" - "She built something better than fireworks. She built community."

Hang in there, my fellow #knowledgegraph researchers and practitioners, soon (in a few years) we will reach the "Slope of Enlightenment" ;-)
The new Gartner hype cycle for AI positions knowledge graphs right in the middle of the "Through of Disillusionment" ... while placing #GenerativeAI and #FoundationModels #LLMs at the peak of the hype
gartner.com/en/articles/what-s(AI,most%20credible%20cases%20for%20investment.
#semanticweb #ai #hypecycle #artificialintelligence

On #TheDataExchangePod: Peter Norvig & Alfred Spector, part of the team of authors behind the highly-acclaimed book, Data Science in Context, a must-read guide on what you need to know to use #DataScience more effectively and ethically.

We discuss their Data Science Analysis Rubric & its relationship with software engineering best practices. #Automation in #datascience #MachineLearning, #SyntheticData, large #NLproc Models and #foundationmodels.
thedataexchange.media/data-sci

The Data ExchangeData Science and AI in ContextPeter Norvig and Alfred Spector on their acclaimed new book on data science, and recent trends in AI.