wangii

I'm surprised nobody mention ELO yet. We used it since 2023.

is kvcache a prematural optimization?

yep, deepseek

`harness` is a term invented/borrowed to describe a vague vision of applying llm in a more controlled manner, suitable for semi organized, complex work. the sad part is then people shift the attention from the real problem but seeking inspiration from the terminology.

the real problem: is there a general framework to allow llm with limited context size to approach problems, just like a capable newbie integrated into a chaotic code base? how does it work?

I think it's an epistemic problem, and my fork of pi: pie (github.com/wangii/pie)

Is Dario Amodei another version of Trump? https://www.youtube.com/watch?v=RDrfE9I8_hs

yep, that's my first thought came to my mind as well. it's a great talk fueled with the passion of engineer, especially relevant in the era of LLM.

good observation! however, I'd argue it's the distribution channel and installation friction did the job in the cases you mentioned.

given how easy it's to replace LLM API in claude code, and how easy it is to write a claude code clone with itself (Fable is pretty good!), the collapse is coming.

Ted Chiang is a great Sci-Fi author, but his remark `GPT-3 and similar models as a "blurry JPEG of the Web"` was misleading at the best.

I share the view with others the term `consciousness` is not well-define yet, therefore his assessment is pointless. Maybe the real question to ask, if consciousness is merely an illusion at the macro level, when the observers not looking at the tech/implementation level deep enough, just like the term "intelligence" itself, might be more precisely captured by drifting amongst high dimensional manifold pitches.

The idea of software developers' job is to translate specification into codes is dying. Now what I'm experimenting is to make my developers into competing project manager and developers are replaced by AI. I think the key advantages of developers, junior or senior, are the process + data oriented style of thinking, therefore way ahead of people from many other domain.

I told my developers: the day of making good money by sitting in front of computer and typing is long gone. Go to the clients' scenes and build the whole thing from scratch, with some assistant from sales and domain experts. Now you are the PM.

what's the difference between Xilem and GPUI? GPUI is used in zed and pretty cool!

It's all about the right mind set at the very top level. At the beginning of the PC era, nobody would bet IBM to lose. Same in the dawn of internet, all money was on MS. so it happened to Nokia and Ericsson.

Google is a giant without a direction. The ads money is so good that it just doesn't have the gut to leave it on the table.

she's done pretty important work but since then obsessed with the vague term `spatial intelligence`. what does it mean? there isn't a clear definition in the piece. it seems very intuitive & fundamental but tbh not *rigorous*, nor insightful.

I bet it's a dead end.

I have only one problem w/ the S1: the creators just not have the guts to kill Mother or Father. Don't get me wrong, I like them but it could make the whole series more distant and cold.

on S2: a total disaster.

I expected to read some nash equilibrium like insight to demonstrate the inevitability of machines turning evil, but got a few headlines.

how is it better than https://github.com/boost-ext/sml ?

there are about 1 million c++ state machines, and sml happens to be the best, or one of them. how does yours differentiate?

could anyone give one sentence pitch why it's better than markdown files?

Maybe it's b/c vast majority not doing well financially?!

Exactly! There is definitely something wrong with FAIR.

it feels like google in panic mode, the only thing it can think of is to put a chatbot everywhere, just b/c it can. I don't see a value proposition at all.

Interesting formulation! it captures the intuition of the "smartness" when solving a problem. However, what about asking good questions or proposing conjectures?

Looks impressive! What are the connection/comparison with imgui though?

The flow based visual programming has always being challenging field, and the problem remains: what are the values added comparing with the text based coding?

I really want to love it, please give me a strong reason.

are you practicing any meditation? it's regarded as "awaken" state in some practice! if you have any method, please share with me! thanks!

According to the original Jacobi decoding paper, it's set in the machine translation tasks, with encoder + decoder, in which parallel algo applied only to the decoder part.

I feel it's a pretty dangerous optimization before we REALLY understand what's going on inside of the LLM. e.g. guys believe in the geometric interpretation will have something to say, and it would probably hurt if you are using "filler" tokens.

Besides, the assumption (not a universal fact) that "forming complete sentences in mind before articulating word by word" seems overly simplifies activities happens in our mind: do we really have a complete planning before start talking/typing? as a Buddhist I lean towards it's an illusion. further more, what about simultaneous thoughts? are we linear thinker in the sentence level?

anyway, pretty neat math!

not able to sign in with github:

Unable to process request due to missing initial state. This may happen if browser sessionStorage is inaccessible or accidentally cleared. Some specific scenarios are - 1) Using IDP-Initiated SAML SSO. 2) Using signInWithRedirect in a storage-partitioned browser environment.

the problem is then the total number of computation drops dramatically therefore leads to much less "thinking" power. i think the idea originated from an understanding that when we write/speak, we have an overall idea. my current hypothesis is it's probably an illusion.

you may want to search for "filler" papers to read.

I believe it's a co-evolving relationship, and it's extremely difficult to track the first/root cause.

People make same kind of mistakes all the time, instead of judging the contents, we look down to things that are "mostly repackaging" what already exist. Brand new things are extremely rare, mostly just remix of things we've seen everyday.