News for hackers. Stuff that matters.

fnetisma

The Github README literally has a "But Why?" section
Re:Ask HN: How is your organization using LLMs? on Friday July 19, 2024 @07:12AM (#41004990)
I’m curious, which software do you use for the lead mining quality improvement use-case you mentioned?
Sure there will be corrective behaviour in the market, and the better product with more outreach, better experience will win over suboptimal products with overlapping offerings, but does that mean that the current generative AI momentum is hollow or there is a sticky use case behind the promises? And if so, in your opinion, how overstated is the Total Addressable Market compared to what’s claimed by an aggregate of startups across the VC space?
Re:Golden Gate Claude on Thursday May 23, 2024 @05:00PM (#40459846)
I would like to know the cost of enabling this type of selective specialization of the models.

If it’s particularly not intensive, I wouldn’t be surprised if model architecture moves towards self-specialization or topic-selection with some effective function calling e.g. model used for a while -> automatically call model specializer after a few queries on the topic -> now use the newly returned specialized LLM

I wonder at what magnitude this could improve model efficacy

Re:Llama3 implemented from scratch on Sunday May 19, 2024 @04:32PM (#40409542)
Iterative leaps of open-source models becoming better are huge examples that companies competing on LLM model layer have an ephemeral moat.

Serious question: assuming this is true, if an incumbent-challenger like OpenAI wants to win, how do they effectively compete against current services such as Meta and Google product offerings which can be AI enhanced in a snap?

Re:GPT-4o on Monday May 13, 2024 @10:57PM (#40351229)
What would be the difference in compute for inference on an audio<>audio model like this compared to a text<>text model?
Re:Show HN: I've built a locally running Perplexity clone on Wednesday April 03, 2024 @07:48PM (#39924830)
This is really neat! I have questions:

“Needs tool usage” and “found the answer” blocks in your infra, how are these decisions made?

Looking at the demo, it takes a little time to return results, from the search, vector storage and vector db retrieval, which step takes the most time?

Re:The U.S. Housing Market vs. the Canadian Housing Market on Saturday September 09, 2023 @03:10PM (#37449191)
Sorry, I wasn’t clear enough, I don’t mean bipartisanship in the political sense. I mean bipartisanship between two groups of people namely real estate owners and people who don’t own real estate. At a general level, sellers want high prices and buyers want lower prices, but the level at which the prices are right now is simply way too high if compared with income per capita to be justified for a home purchase, and correction to “USA levels” assuming that’s the baseline is also not justifiable as home equity is a huge chunk of everyone’s wealth
Re:The U.S. Housing Market vs. the Canadian Housing Market on Saturday September 09, 2023 @02:47PM (#37448907)
If you talk to anyone here in Canada there is bipartisanship. Real Estate owners and non-owners both agree housing prices to be a huge issue around Canada right now, but the former would never budge on reducing the prices as a means to a solution. They have too much invested too late. Non-owners on the other hand want price corrections to take place, but systemic issues such as a rising population due to immigration [1] and increasing construction costs [2] are causing upward pressure.

[1] https://www.cbc.ca/amp/1.6938242

[2] https://thoughtleadership.rbc.com/proof-point-soaring-constr....

Re:Astral on Tuesday April 18, 2023 @02:54PM (#35618300)
I'm trying to use this via ssh into another instance on VSCode, but it doesn't work, any help?
Very detailed article! I was wondering however if, during your application of this strategy, you've found that a lack of company (and team) loyalty has reduced the quality of relationships you've made?