chrisXOXO

It might have been said by somebody here but I believe these models are like information compilers. Sure they seem like “next token prediction” but AGAIN this undersells them. I once encoded leetcode solutions by replacing each keyword, variable and operation with another token, then rotated the lines. The model could tell exactly which problem the code solved. They can naturally find signal, ALWAYS!!

Touché

I am citing out of my head here, but think deepseek’s inference engine with their models create around 30 dollars per hours while it costs around 4 dollars, there might be other costs but if you look at the demand, it will become very profitable. I don’t understand why people are pessimistic about the profitability (I don’t want them to be this successful either). BUT why would they care about profitability right now. They believe in AGI, so do the big money people. They get their investments. This train is not stopping and I believe their predictions are correct (IMO we should not debate about timescales apart from spreading urgency). And for the lowering of prices, it is possible because they just can and hooking people now into their systems will be 10x more profitable in the future. In addition to all the juicy training data they get with real world clients. They are scared the others win, they are not scared that they run out of money.

I guess that would scenario would decrease my p(doom).

But would you not agree that writing less code by hand and even looking less at code at all becomes more practical with each new model? If we extend this trajectory, we should see that the time interacting directly with code becomes less and less.

Genuinely, what makes people not believe in coming AGI? I read quite a lot on hackernews but never encounter a strong post/comment against it, apart from the „what is marketing“ discussion. Maybe people don’t bother because everyone is in their trenches, tough I don’t understand how people do not see the AGI coming. What kind of doom, if any, will befall is something different of course. I don’t want to believe there will be AGI in the next 5 years, but it sure is hard not to!

Laughted out loud

For Firefox and surely for Chrome and Safari aswell, there are vim extensions. I have one, it’s beautiful and wouldn’t want to miss it.

Idk, but for me it is ridiculous, people still doubt these valuations. SpaceX was of course non sense. But to value those companies lower than 1 trillion??? Please, link some source to change my mind.

I would like a reassessment of that. This was 2023. I imagine the only ones filling the moat is Chinese labs, but there are other significant obststacles for even Chinese models. Even if they would become as good as their American counterparts, the distribution and inference is mostly in the ballpark of Anthropic and OpenAI. But I don’t know anything, so I would love to hear other opinions.

Thanks :)

I am really wondering, how they tackle the long trail problem of unknown situations. Sure they are monitor them constantly but I am asking precisely, how to handle situations that occur ridiculously infrequently: do they sample them 1000x in sim? Or do they use a different model and track uncertainty in the model constantly? How to get another 0 between the dot and the percent sign in situations where the model makes the wrong choice with a significant probability?

Because it encourages him to work against the administration.

Can anybody explain, what Tenstorrent market position is? I know only little about Hardware design and manufacturing.

I have never really looked at ad revenues, but honestly those numbers seem reasonable and crazy at the same time (or their calculation at least). My main issue is, that I hate oligopolies. For many industries I think a country can protect itself against oligopolies from outside. But everything digital comes out of little valley on the west coast. This really bothers me.

That idea feels really relevant to me as a future research direction(not an expert). Could maybe someone explain what I am missing here? Why does this idea not get more attention?! Is it not new? And if so, could one state why it is not commonly employed?