News for hackers. Stuff that matters.

permanent

Re:Ask HN: What are you working on? (April 2025) on Monday April 28, 2025 @07:28AM (#43820062)
Looks interesting and would love to try it out! but your repo is missing a Open Source license (https://github.com/rasulkireev/marketing-agents)
Re:MacBook Air M4 on Wednesday March 05, 2025 @09:37AM (#43266987)
This is amazing, yet silly to state "Up to 23x faster performance [4]"

[4] against, 1.2GHz quad-core Intel Core i7-based MacBook Air

Re:The $100T Disruption: The Unforeseen Economic Earthquake on Saturday March 01, 2025 @04:53PM (#43224103)
There is not evidence to suggest general impulse control. That's extrapolation (beyond food items) and likely untrue IMHO.
Engagement-optimized writing style (whether intentionally or subconsciously learnt to do so)
Re:Open Euro LLM: Open LLMs for Transparent AI in Europe on Tuesday February 04, 2025 @04:41AM (#42930297)
> China, all you need is some money and smart people

No way

-- copied

Complete hardware + software setup for running Deepseek-R1 locally. The actual model, no distillations, and Q8 quantization for full quality. Total cost, $6,000. All download and part links below:

Motherboard: Gigabyte MZ73-LM0 or MZ73-LM1. We want 2 EPYC sockets to get a massive 24 channels of DDR5 RAM to max out that memory size and bandwidth. https://t.co/GCYsoYaKvZ

CPU: 2x any AMD EPYC 9004 or 9005 CPU. LLM generation is bottlenecked by memory bandwidth, so you don't need a top-end one. Get the 9115 or even the 9015 if you really want to cut costs https://t.co/TkbfSFBioq

RAM: This is the big one. We are going to need 768GB (to fit the model) across 24 RAM channels (to get the bandwidth to run it fast enough). That means 24 x 32GB DDR5-RDIMM modules. Example kits: https://t.co/pJDnjxnfjg https://t.co/ULXQen6TEc

Case: You can fit this in a standard tower case, but make sure it has screw mounts for a full server motherboard, which most consumer cases won't. The Enthoo Pro 2 Server will take this motherboard: https://t.co/m1KoTor49h

PSU: The power use of this system is surprisingly low! (<400W) However, you will need lots of CPU power cables for 2 EPYC CPUs. The Corsair HX1000i has enough, but you might be able to find a cheaper option: https://t.co/y6ug3LKd2k

Heatsink: This is a tricky bit. AMD EPYC is socket SP5, and most heatsinks for SP5 assume you have a 2U/4U server blade, which we don't for this build. You probably have to go to Ebay/Aliexpress for this. I can vouch for this one: https://t.co/51cUykOuWG

And if you find the fans that come with that heatsink noisy, replacing with 1 or 2 of these per heatsink instead will be efficient and whisper-quiet: https://t.co/CaEwtoxRZj

And finally, the SSD: Any 1TB or larger SSD that can fit R1 is fine. I recommend NVMe, just because you'll have to copy 700GB into RAM when you start the model, lol. No link here, if you got this far I assume you can find one yourself!

And that's your system! Put it all together and throw Linux on it. Also, an important tip: Go into the BIOS and set the number of NUMA groups to 0. This will ensure that every layer of the model is interleaved across all RAM chips, doubling our throughput. Don't forget!

Now, software. Follow the instructions here to install llama.cpp https://t.co/jIkQksXZzu

Next, the model. Time to download 700 gigabytes of weights from @huggingface! Grab every file in the Q8_0 folder here: https://t.co/9ni1Miw73O

Believe it or not, you're almost done. There are more elegant ways to set it up, but for a quick demo, just do this. llama-cli -m ./DeepSeek-R1.Q8_0-00001-of-00015.gguf --temp 0.6 -no-cnv -c 16384 -p "<|User|>How many Rs are there in strawberry?<|Assistant|>"

If all goes well, you should witness a short load period followed by the stream of consciousness as a state-of-the-art local LLM begins to ponder your question:

And once it passes that test, just use llama-server to host the model and pass requests in from your other software. You now have frontier-level intelligence hosted entirely on your local machine, all open-source and free to use!

And if you got this far: Yes, there's no GPU in this build! If you want to host on GPU for faster generation speed, you can! You'll just lose a lot of quality from quantization, or if you want Q8 you'll need >700GB of GPU memory, which will probably cost $100k+

Re:Show HN: I am Building a Producthunt alternative on Monday November 25, 2024 @03:22PM (#42239800)
Added an icon, and still it says:

> Product icon is required

in short, money and ethics
Please do spare a couple of days on it. I think noone would really believe it until seeing it :)
Re:Yaak Is Now Open Source on Wednesday September 11, 2024 @05:49AM (#41509756)
Yaak is open source
This seems quite reasonable imo
Re: on Tuesday June 25, 2024 @04:58PM (#40793525)
just so u know, kakaotalk does exist in multiple languages. feels like this whole thread is based on a false assumption

>Kakaotalk is in English, French, German, Indonesian, Italian, Japanese, Korean, Portuguese, Russian, Simplified Chinese, Spanish, Thai, Traditional Chinese, Turkish, Vietnamese (https://apps.apple.com/us/app/kakaotalk/id362057947)

Re: on Tuesday June 25, 2024 @04:53PM (#40793475)
Kakaotalk is in English, French, German, Indonesian, Italian, Japanese, Korean, Portuguese, Russian, Simplified Chinese, Spanish, Thai, Traditional Chinese, Turkish, Vietnamese (https://apps.apple.com/us/app/kakaotalk/id362057947)
Re:Mobifree – An open-source mobile ecosystem on Tuesday May 28, 2024 @11:08AM (#40501439)
Perhaps because EU just passed a law for third party app stores?
Re:I turned my open-source project into a full-time business on Tuesday February 27, 2024 @10:37AM (#39525290)
EU is very large. If I were to believe your posts, Germany has achieved good protection of employees from their employers. Simply not true in ... many non-Germany EU countries.
Re:I turned my open-source project into a full-time business on Tuesday February 27, 2024 @10:35AM (#39525275)
1) That may be allowed in Germany. Definitely not in Poland and many other countries.

2) In my experience, not true. Most often an employee needs to get a pre-approval that often take too long. As a full time developer, there's difference between playing soccer and developing software.

Re:What Happened to GE? on Monday January 15, 2024 @06:36PM (#39007532)
While GE price has gone up in the last 2 years, your statement doesn't take account for a reverse split—a 1-for-8 stock split in 2021.

https://www.forbes.com/advisor/investing/ge-stock-split/#:~:....

Re:AI’s big rift is like a religious schism on Tuesday December 12, 2023 @03:39PM (#38618145)
It is very bad. There's more money and fame to be made by taking these two extreme stances. The media and the general public is eating up this discourse, that are polarizing the society, instead of educating.

> What things?

There are helpful developments and applications that go unnoticed and unfunded. And there are actual dangerous AI practices right now. Instead we talk about hypotheticals.

We should also name the artist, DAKD JUNG. He also sells audio visualizers based on this concept
Re:Consensus: Use AI to find insights in research papers on Thursday August 17, 2023 @07:01PM (#37169393)
Because providing always accurate LLM-based paraphrasing would be much more difficult.
Re:Google Med-Palm M: Towards Generalist Biomedical AI on Thursday July 27, 2023 @03:49AM (#36890310)
I work in this field - IMO, your assessment is correct insofar as the absolute need for commercialization of research done. However, we haven't gotten to the super-human performance for medical images yet. We don't even have the ImageNet-equivalent, nor do we have any open source (or just source & weight available) models that Google and other big corp claim to be so wonderful. Most of people in the field, rightly so, then dismiss anything like Med-Palm M and other PR-like papers from these groups. Why base your career (both academically and product-wise) on this?
Re:Google Med-Palm M: Towards Generalist Biomedical AI on Thursday July 27, 2023 @03:38AM (#36890216)
I won't take any of this seriously until they make their model and weights available.

This type of PR research is what is really holding back AI for medical images.

Agreed. Truly despise when otherwise smart tech bloggers use jargons (incorrectly) to appear authoritative

Ask HN: How to Respond/Present

Hi,My friends and I have been working on a side, but passionate, project using LLM. Recently, a well-known consulting company has contacted us asking for a demo session and details about the underlying system/model. Initially, I was confused because the product is already available (free trial), so not sure how to present a demo. Otoh, the system/model may be our secret sauce.How should I...

( Read More... | 3 comments | on HN )
Re:Ask HN: In depth sites for various industry's news? on Thursday December 22, 2022 @10:37AM (#34094390)
Financial reports and news of companies and stocks (mostly US, I think), focusing on values and fundamentals. I found other similar sites to be too much about short term trends and technical analysis.

https://marketinference.com

Re:Twitter is shutting down Revue on Thursday December 15, 2022 @03:02AM (#33996554)
Any recommendation for substitutes?
Re:Show HN: Stable Diffusion v2 web interface on Thursday November 24, 2022 @04:50PM (#33736616)
I'd love to know this as well.
Re:Ask HN: Who runs a small/medium website supported by ads? on Monday November 14, 2022 @05:19PM (#33602098)
The internet says one can make $5-20 / 1000 views from adsense.

I'd like to hear specific cases if anyone wants to share

Re:Ask HN: Who runs a small/medium website supported by ads? on Monday November 14, 2022 @05:15PM (#33602050)
I'm curious about exact numbers, if you don't mind sharing!

Just because the cost neutral could mean a few dollars (static) to a few hundreds.

Older »