News for hackers. Stuff that matters.

riddleronroof

Re:Ask HN: What are you working on this Christmas Eve? on Wednesday December 25, 2024 @06:23PM (#42511912)
:) Yeah I think I just need courage to say it’s good enough.
Re:Cost Per 1M tokens Of Self Hosting Llama-3 on Friday June 14, 2024 @07:55PM (#40686309)
Ollama is llamma.cpp plus docker If you can do without docker, it’s faster

Show HN: Zero dependency LLM standby, rollouts, no proxy

https://github.com/virevolai/logos-shift-client

We believe you should not rely on any company for your critical LLM infra.This does not proxy via another service that might go down or be beholden to whims of some board.We wrote logos-shift for our own needs and are open sourcing it.What it does:- Save input/output data, no proxy, no slowdowns, double buffering, separate thread- Finetune your own model, or we can for a fee.- Auto rollout your...

( Read More... | no comments | on HN )
Re:Home Assistant 2023.11 on Thursday November 02, 2023 @10:17AM (#38113835)
Nice work

Last I looked, the industry was trying to roll out some protocols to block open source efforts.

Is there a plan to tackle that?

Re:Talk-Llama on Thursday November 02, 2023 @10:06AM (#38113691)
ollama wraps llama.cpp into a docker container, correct? Besides that it seeks like a go server for chat?

Show HN: Logos Shift Cloud – automatically finetune and replace expensive LLM

https://api.bohita.com/

Great LLMs are best at general tasks.However, once you know what you want, you should finetune and switch to your finetuned LLM.Logos Shift Cloud handles this automaticallyAll you need is to add this to your call:``` @logos_shift(dataset="story") def get_story(model, messages): """Generates a story""" completion = expensiveLLM.create(model=model, messages=messages) story_d =...

( Read More... | no comments | on HN )

Show HN: Logos Shift – Finetune your own LLM and rollout seamlessly, local/cloud

https://github.com/virevolai/logos-shift-client

Introducing Logos Shift, an open source Python library designed to transform how developers integrate Large Language Models (LLMs) into production systems.General purpose LLMs are very expensive. You can finetune and rollout your own at a fraction of the cost. We can do it for you too.Highlights of Logos Shift:Automated Rollout: With just a single line of code, you can integrate your fine-tuned...

( Read More... | no comments | on HN )
Re:India's biggest tech centers named as cyber crime hotspots on Thursday September 21, 2023 @09:36AM (#37597423)
Very odd that criminals go where the money is
Re:US aircraft shoots down new airborne object over Canada on Saturday February 11, 2023 @08:45PM (#34758643)
What are the chances these are warnings by another power for Ukraine?
No no it’s called “quiet quitting”
Re:Is tipping getting out of control? Many consumers say yes on Monday January 23, 2023 @07:52PM (#34497495)
So it used to be 18% off the base.

But credit card receipts show 18% off the price + tax, effectively 20-25%

Most don’t do the math, just pay.

Funny. I am a backend engineer and think so about front end.
Amazing project! Looks like it needs to control the DOM. Is there a way to use this with react?
Re:WebAssembly: Docker Without Containers on Wednesday December 21, 2022 @09:36AM (#34081221)
Thank you for these details. Always suspected these claims but hadn’t dug deep enough.

Seems like some X can now run in wasm should come with disclaimer (includes Linux)

Re:Artificial womb facility concept for 30k babies per year on Monday December 12, 2022 @11:02AM (#33956150)
Is this even real?
Re:India fines Google $162M for anti-competitive practices on Thursday October 20, 2022 @01:21PM (#33277828)
In other words, Ambani’s Reliance co will launch search next month.
Nice work with go. There is this for python in webassembly as well : https://pyodide.org/en/stable/index.html
Re:Should billboard advertising be banned? on Wednesday October 05, 2022 @10:33AM (#33096063)
They don’t need to be, because they are obsolete. Online accounts for most. And in-person are going to change to drones / smart billboards.
Re:Figma: A Random Walk in Palo Alto on Sunday September 18, 2022 @09:01PM (#32893082)
Repeat of what?
Re:Penpot: Open-source design and prototyping platform on Thursday September 15, 2022 @09:57AM (#32852042)
Haha this. And now someone put copilot in vim.
Re:The self-fulfilling prophecy of React on Thursday September 08, 2022 @09:48AM (#32765459)
Vite works with React. And you can get the same performance as Vue. I get thé author’s general point. But most of us are not trying to innovate on front end frameworks. And a CTOs job is to make a better product. Not a playground for their experiments.
Isn’t this a good thing? Every Facebook employee should not know where all PII is. Further, it doesn’t say what data they were looking for. Eg Around the time of the scandal, lots of Facebook quizzes were asking for PII. but it was not stored at facebook. I’m not a Facebook fan, but I’m not a fan of unfounded scary stories either.
Re:Animating Prompts with Stable Diffusion on Friday September 02, 2022 @08:33AM (#32689850)
In the future we will say “trending on Hacker News”
Re:Meta is building an AI to fact-check Wikipedia on Friday August 26, 2022 @11:20PM (#32615311)
Does FB contribute to Wikipedia’s funding? Can they fact check the current news? Color me skeptical.
Re:Tactical Combat Umbrella on Friday August 26, 2022 @11:18PM (#32615300)
I don’t know about the latter. Living in NYC, my umbrellas either break because of the wind, or, because I forget them somewhere.

But maybe others have had better luck?

Re:Tactical Combat Umbrella on Friday August 26, 2022 @10:32PM (#32615044)
Who needs this? Mary Poppins in a bad neighbourhood?
Exactly. These are opinion pieces with scary headlines. Almost nothing to back them up. Also strange to talk about developing countries having problems. They usually have chimneys. Hydrochlorides are there because of pans coated with them that burn them off. Guess what, they still end up in food no matter which heating you would use. So the problem is pans, not the heat. Cooking with fire is Lindy. And there is no other way to make rotis, tatziki (char the eggplant) and other things without fire.
Well that’s fresh. But if the user data is anonymized, it’s OK, right? I’m assuming there isn’t any other PII.

Older »