Kungfuturtle
To my surprise I couldn't find any proper explainers of the term in a quick search, despite grokking it after seeing it in various contexts on Twitter, but Fable 5 offered a useful analogy: "A student who memorized worked solutions and one who understands the subject score the same on the test; you can only tell them apart by asking a question the test didn't. Real-world use is nothing but those questions, which is why a single AA number feels right and wrong at the same time."
In other words, big model smell is related to the underlying ability to "understand" when tasks are underspecified or out-of-distribution. This ability can be mimicked to parity by smaller, distilled models according to the density of the training data for particular tasks, but neural scaling laws still hold for generalized reasoning ability.
More recently with these smaller models, there's a separate but related "RL-fried" phenomenon, where they rely on CoT to "grind toward a checkable answer even in contexts (open dialogue, taste, ambiguity) where there is no checkable answer, and you get the tell: over-hedged, over-structured, relentlessly on-task, deaf to the subtext."
There are some other insights and caveats in the (short) conversation that I feel you may appreciate reading. [1]
[0] https://x.com/aidan_mclau/status/1807843014104211855 [1] https://claude.ai/share/d511a348-7c36-432f-a6d5-9deab2802615
[0] <https://onlinelibrary.wiley.com/doi/pdf/10.1002/%28SICI%2910...>
[1] <https://www.liverpooluniversitypress.co.uk/doi/book/10.3828/...>
The "alternative" you envision is premised on shifting power back to the masses, but I think it's also important to mention guardrails to prevent excessive capital accumulation. There would still be an economy, but it would be driven by a more egalitarian aggregate demand and less likely to suffer the shocks of boom bust cycles associated with financial malarkey.
[0] https://www.professionalptandtraining.com/balance-strategy-b...
[1] https://www.neurolab360.com/blog/balance-and-proprioception
There may yet be something to Teilhard de Chardin's take on the Noosphere which exists in a matrix of consciousness that spans planets, solar systems, galaxies, galaxy clusters, and indeed universes!
What if, for example, food that would spoil in a couple more days were simply moved to a "free" section of the grocery store? No need for complex shipping or logistics costs, simply ask the stocker to move from one aisle to another. Why don't grocery stores do that, if they're concerned about "reducing waste"?
Dont feed the trolls, folks.
It will be somewhat difficult to retrofit buildings to take advantage of e.g. thermal mass inertia, but I'm hopeful that new construction will increasingly favor passive/low-energy cooling methods.
Security lapse exposed Clearview AI source code - https://news.ycombinator.com/item?id=22892494
Also links to the full article on Tech Crunch.
¯\_(ツ)_/¯
More seriously, my guess is that you enjoy those streets because there's so much more character to them. They are generally part of an older, more storied urban core, so the streets are more imbued with a "there"ness of the community.
Contrast this with the experience of walking down a recently-gentrified street.
My parents' generation on the other hand range from moderate supporters, who have "some qualms" about e.g. Kashmir/Assam, to fervent supporters of his nationalist identity and agenda.