News for hackers. Stuff that matters.

latentnumber

Re: on Thursday October 16, 2025 @10:18AM (#45605661)
k.
Re:Improved Gemini 2.5 Flash and Flash-Lite on Thursday September 25, 2025 @02:45PM (#45377095)
"the" is redundant is probably what GP means.
Re:Flounder Mode on Thursday July 03, 2025 @11:18AM (#44455934)
Kevin Kelly on a different way to do great work.
Re:Language Models in Plato's Cave on Sunday June 29, 2025 @10:34AM (#44413492)
> This explains why video prediction models that learn about the physical world have so far not yielded the same results as next-token prediction on language: while we might hope that models that learn from videos might acquire representations of the physical world in the same way that humans learn through experience, the LLMs have managed to skip this step and simply copy some aspects of human mental representations without having to figure out the learning algorithm that allowed humans to acquire those representations in the first place.
Re:Language Models in Plato's Cave on Sunday June 29, 2025 @10:33AM (#44413478)
> In science, we might suppose that the more simple, elegant, and powerful a theory is, the more likely it is to be the right one – there are many ways to write down an equation to describe the oscillation of a spring, but we take Hooke’s law to be the “right” theory because it provides both remarkable simplicity and high predictive power. Similarly, we might suppose that if we have an algorithm that is simple, elegant, and explains similar essential functions as the human mind, then it is likely to be the right model of the mind’s computational processes. That is, if LLMs are trained with a simple algorithm and acquire functionality that resembles that of the mind, then their underlying algorithm should also resemble the algorithm by which the mind acquires its functionality. However, there is one very different alternative explanation: instead of acquiring its capabilities by observing the world in the same way as humans, LLMs might acquire their capabilities by observing the human mind and copying its function. Instead of implementing a learning process that can learn how the world works, they implement an incredibly indirect process for scanning human brains to construct a crude copy of human cognitive processes.
Re: on Saturday June 28, 2025 @05:39PM (#44408387)
Re:AI: Accelerated Incompetence on Wednesday May 28, 2025 @09:06AM (#44115610)
I would agree with this if the LLM never really modified the initial linear embeddings, but non-linearity in MLP layers and position/correlation fixing in the attention layers would mean that things are not so simple. I’m pretty sure there are papers showing compositionality and so on being represented by transformers.
Re:Why Everything Is CRUD on Monday August 26, 2024 @03:57AM (#41354942)
Absolutely! Everything I design, I basically cast it as ER. I'm not even a backend developer but this is such a useful and universal framing (for me, at least, or so I thought) that I always used to wonder what the "real" backend engineers do.
Re:Looming Liability Machines (LLMs) on Saturday August 24, 2024 @09:18PM (#41343479)
Why not automate verification itself then? While not possible now, and I would probably never advocate for using LLMs in critical settings, it might be possible to build field-specific verification systems for LLMs with robustness guarantees as well.
When do you choose to moderate? Why is moderation an assumption for maintenance if you are maximizing over an individual anyway?
But what you're assuming is a static starting position. The entire point of liberalism is, if you read the essay, to be fair. It is absurdly unfair to that one person and I'm pretty sure they'll never be able to advance in this society. This is not just about that one person though, it's the perception that society does not really care about an individual and that individual can be you. However, fairness is the starting position in Junkland and the argument is that this begets progress while a society like Omelas shows a complete disregard for fairness. This was the spirit of the original position.
> It seems like this would be a very useful starting point for LLM quality engineering, at least for simple inference.

Interesting. Can you elaborate on this? You mean this test can function as a metric or is it just an evaluation for applications?

Re:Study: Consumers Actively Turned Off by AI on Tuesday August 13, 2024 @01:12AM (#41232467)
Exactly. Beautifully written. Relatedly, a friend is working on an AI interviewer and when I tried her prototype, it felt extremely dehumanizing. "But it's efficient."
Re:Scrum is the Symptom, not the Problem on Wednesday August 07, 2024 @03:55PM (#41184755)
lol.
Re:CrowdStrike to Delta: Stop pointing at us on Monday August 05, 2024 @12:58PM (#41163107)
Yes, because that incentivizes such companies to be more diligent.

Older »