News for hackers. Stuff that matters.
Re:What's the best explanation for LLMs being almost right w... by squircle on Sunday June 09, 2024 @10:23AM (#40624619)
Perhaps... but "prompt engineering" right now seems like throwing paint at a wall until the black box evaluates to the relative "truth" you were looking for. It's like a stochastic wrench you turn until it serves your intensive porpoises.

Tokens? The way I see these things operating (in my head) is as a hyper-dimensional merge sort which lose there context/bounded-domain during evaluation, leading to something less than the sum of its parts because the weights between tokens correlate linguistic/phonetic relationships--which lose their causal-relationship to the real world.

There are no comments on this comment yet.