News for hackers. Stuff that matters.

heinrichf

Re:Gemma 3 Technical Report [pdf] on Wednesday March 12, 2025 @06:14AM (#43341574)
I'm comparing Gemma3 12 B (https://ollama.com/library/gemma3; running fully on my 3060 12GB) and Mistral Small 3 24B (https://ollama.com/library/mistral-small; 10% offloaded to the CPU).

- Gemma3 12B: ~100 t/s on prompt eval; 15 t/s on eval

- MistralSmall3 24B: ~500 t/s on prompt eval; 10 t/s on eval

Do you know what different in architecture could make the prompt eval (prefill) so much slower on the 2x smaller Gemma3 model?

Re:Restic: Backups done right on Sunday October 13, 2024 @03:28PM (#41830810)
Restic has a mount subcommand that exposes all backups through a FUSE filesystem, no?
Re:Scramble: Open-Source Alternative to Grammarly on Wednesday September 18, 2024 @08:58AM (#41579168)
There is also an alternative more lightweight self-hosted server in Rust, compatible with the official clients: https://github.com/cpg314/ltapiserv-rs
Re:Transformers for software engineers on Sunday April 03, 2022 @02:47AM (#30894983)
It's to access the tuple's single element, but the author could have used #[repr(transparent)]
Re:How Audio Fingerprinting Works on Sunday January 02, 2022 @05:40AM (#29767592)
(2020). See also https://news.ycombinator.com/item?id=9870408, which I found more interesting (and that the author should probably have referenced).
Re:The Mathematical Pranksters Behind Nicolas Bourbaki on Wednesday March 31, 2021 @01:58PM (#26650673)
Commenting as a mathematician who sometimes uses the Bourbaki books as reference for research: this is probably not a good idea. These books have a very dry style and in particular rarely contain detailed examples, motivation for definitions, or intuition for theorems.

They are great for reference if you already know the subject, but if you want to learn something, you'd be better off using introductory textbooks for the various fields you're interested in. I'm happy to make recommendations, and you can also look up syllabi for math undergrad at Stanford, Princeton, etc.

Re:AI maths whiz creates tough new problems for humans to solve on Saturday February 06, 2021 @04:41PM (#26050227)
This page appears as if it was written by the authors or the PR department of the university...
Re:AI maths whiz creates tough new problems for humans to solve on Saturday February 06, 2021 @04:13AM (#26045328)
The praise from popular press and the promotion by the authors should be put into context of what mathematicians think of it.

Two blog posts by a professor at U. Chicago, qualifying it of intellectual fraud:

https://www.galoisrepresentations.com/2019/07/17/the-ramanuj...

https://www.galoisrepresentations.com/2019/07/07/en-passant-...

Discussion on /r/MachineLearning with caveats here: https://www.reddit.com/r/MachineLearning/comments/jkrzlt/d_a...
Re:High-Resolution 3D Human Digitization on Sunday June 14, 2020 @04:29AM (#23516004)
The last author and his company were/are involved in scandals about faking results on a large scale:

https://www.reddit.com/r/MachineLearning/comments/8zm4kl/d_l...

http://sadeghi.com/dr-iman-sadeghi-v-pinscreen-inc-et-al/

Re:SpaceX Software Team AMA on Sunday June 07, 2020 @05:02AM (#23445900)
I'm surprised to read they used a Linux (ok patched with PREEMPT_RT) for real-time safety critical software.
Re:Moving Away from Gmail on Sunday April 12, 2020 @02:53AM (#22846498)
> The company is based in Switzerland and is French speaking. Any chance "AdVite" means something different in French?

No, it doesn't mean something different in French.

See this blog post from a radiologist and ML researcher: https://lukeoakdenrayner.wordpress.com/2020/03/23/ct-scannin...
Re:Employee Scheduling on Monday March 16, 2020 @02:05PM (#22595452)
By the way, thanks a lot for sharing your story and code back then, I learnt a lot from it.
Re:Employee Scheduling on Sunday March 15, 2020 @03:10PM (#22585812)
Thank you for your interesting explanation. That reminds me of the deferred acceptance algorithm https://en.wikipedia.org/wiki/Gale%E2%80%93Shapley_algorithm
Re:Employee Scheduling on Sunday March 15, 2020 @03:03PM (#22585762)
See also the story of Staffjoy mentioned in another comment (https://news.ycombinator.com/item?id=22583653) YC fellowship, they couldn't find a market, and shut down: https://hn.algolia.com/?q=staffjoy
Re:The TeX Pestilence (Why TeX/LaTeX Sucks) on Thursday January 23, 2020 @02:31AM (#22125613)
As a professional mathematician, I see it the same way a musician views musical notation. Sure, writing the name of each note on the stave would be easier to read at first, but the seemingly complex notation then allows for a much quicker understanding (see how talented pianists can sight read very complicated scores; I doubt this could be possible with a more verbose notation). Similarly, I have no trouble parsing (correctly written) LaTeX mentally.
Re:The TeX Pestilence (Why TeX/LaTeX Sucks) on Thursday January 23, 2020 @01:55AM (#22125434)
I feel that the author saying LaTeX is bad because it is (in particular) not based on a GUI/point-and-click system, and preferring Microsoft Equation Editor/Outline to it, reveals a big misunderstanding.

I also don't see how Mathematica's notation is any better; I view it as way worse.

Re:Postdoc Myths on Tuesday January 21, 2020 @01:41AM (#22104766)
This is exactly one of the points raised in the text. Non-TT assistant professorships are indeed postdocs, which often come with more teaching load than other fellowship-based postdocs. This is for example the case of the "Hills Assistant professorship" at Rutgers
Re:Postdoc Myths on Monday January 20, 2020 @04:25PM (#22102215)
This is so simply not true, or highly subfield-dependent. Unless you are a superstar, there is no way you get a TT job without a postdoc in math.
Re:The economics of unused gift cards on Tuesday January 07, 2020 @02:02AM (#21977674)
An economist one said "Socks and gift cards are the junk bonds of gifts"

https://www.npr.org/2019/12/16/788587668/the-efficient-chris...

Re:How Transformers Work (2019) on Monday January 06, 2020 @02:26AM (#21967257)
Not useless at all, you're welcome and I'm happy to hear that my opinion about the above link is shared by someone ;)
Re:How Transformers Work (2019) on Sunday January 05, 2020 @06:09AM (#21960729)
This looks like a dumbed down/partly stolen version of http://jalammar.github.io/illustrated-transformer/ (and his other posts). towardsdatascience usually screams "low quality content" :/
@nicodjimenez Could you give the HN audience a quick idea of the technology behind this? Recurrent ConvNets like in https://guillaumegenthial.github.io/image-to-latex.html ? I remember seeing an "image to LaTeX" academic challenge, do you plan competing in it, if it still exists?
Re:The Apple Watch can detect atrial fibrillation: so what now? on Wednesday December 25, 2019 @06:03AM (#21878036)
Alas the article is behind a hard paywall and not available on Sci-Hub...

Older ยป