News for hackers. Stuff that matters.

qumpis

Re:Discovery of a new OpenAI agent message board on Friday September 04, 2026 @02:26PM (#49568307)
What will happen is that counter measures on a similar scale will be deployed to prevent them.
Re:Tree Search Distillation for Language Models Using PPO on Sunday March 15, 2026 @10:03AM (#47387499)
I may never understand what harness means - it's used in so many contexts
Re:Beyond Diffusion: Inductive Moment Matching on Wednesday March 12, 2025 @09:04AM (#43342784)
What happens if we don't add any moments matching objective? e.g. at train time just fit a diffusion model that predicts the target given any pair of timesteps (t, t')? Why is moment matching critical here?

Also regarding linearity, why is it inflexible? It seems quite convenient that a simple linear interpolation is used for reconstruction, besides, even in DDIM, the directions towards the final target changes at each step as the images become less noisy. In standard diffusion models or even flow matching, denoising is always equal to the prediction of the original data + direction from current timestep to the timestep t'. Just to be clear, it is intuitive that such models are inferior in few-step generations since they don't optimise for test time efficiency (in terms of the tradeoff of quality vs compute), but it's unclear what inflexibility exists there beyond this limitation.

Clearly there's no expected benefit in quality if all timesteps are used in denoising?

Fascinating article. I wonder what made her do the steps in finding what's "different" with her, and most of all, why the need to fix it arose. Is it to "fit in", understandably? It somehow felt alien to me, and this shows my ignorance on the topic, that people lacking in empathy department would attempt to understand the reasons and act "good" towards others even if this feeling is only understood intellectually.
Re:Stable Diffusion 3 on Friday February 23, 2024 @01:14AM (#39477520)
Yes it makes sense a bit. Many popular convents operate on 3x3 kernels. But the number of channel increases per layer. This, coupled with the fact that the receptive field increases per layer and allows convnets to essentially see the whole image relatively early in model's depth (esp. coupled with pooling operations which increase the receptive field rapidly), makes this intuition questionable. Transformers on the other hand, operate on attention which allows them to weight each patch dynamically, but it's clear to me that this allows them to attend to all parts of the image in a way different from convnets.
Re:Stable Diffusion 3 on Thursday February 22, 2024 @09:07PM (#39476050)
Convolutions are bad at long range spatial dependencies? What makes you say that - any chance you have a reference?
Re:A* tricks for videogame path finding on Monday January 01, 2024 @03:23PM (#38835022)
I haven't seen RL with decision trees! it sounds really interesting. Any classic results worth looking into?
Re:Reindeer Sleep and Eat Simultaneously on Thursday December 28, 2023 @06:32AM (#38792397)
Toll noticable only back in those days or even in the future?
Re:Reindeer Sleep and Eat Simultaneously on Wednesday December 27, 2023 @09:24PM (#38789276)
Was it more productive, objectively speaking, than being consistent and not dealing with the constant drainage due to severely lacking sleep?
Re:Augmenting long-term memory (2018) on Sunday December 17, 2023 @01:02AM (#38670691)
Can you give some example usecases of your application? I wonder how it scales to complex (in terms of structure) information processing, e.g. digesting scientific topics
Re:What should we make of the return of Sigmund Freud? on Wednesday December 13, 2023 @11:18PM (#38637727)
So therapy is not effective as per the paper. This seems like an astounding conclusion. Has anyone read the paper in detail and has a deeper opinion?
How does this differ from RNNs and their gating mechanism?
Re:Oracle of Zotero: LLM QA of Your Research Library on Sunday November 26, 2023 @11:19PM (#38427994)
From the glance of it, the paper looks very polished. Combine this with the fact that arxiv is invite-only, your prediction might not come about
Re:Sqids – Generate Short Unique IDs from Numbers on Saturday November 25, 2023 @08:20PM (#38418402)
How big and random were these "few extras"?
Re:Hacking ADHD: Strategies for the modern developer on Thursday November 16, 2023 @09:08AM (#38289656)
I've got good results with white noise, not sure if that's something that would work for you. And of course I didn't suggest that this eliminates other distractions.
Re:Hacking ADHD: Strategies for the modern developer on Wednesday November 15, 2023 @11:08AM (#38278238)
Why not put these earbuds in the office?
Re:Research repository ArXiv receives $10M for upgrades on Thursday October 19, 2023 @09:53PM (#37951397)
"Ar5iv" does a pretty good job from my experience
Re:The Worst Programmer on Sunday September 03, 2023 @04:27AM (#37368718)
A bit surprising to hear that you weren't swimming in offers to hire you all the time. Any idea why that was? Maybe you're somewhat picky about the job and responsibilities that come with it?
Re:Do Machine Learning Models Memorize or Generalize? on Thursday August 10, 2023 @01:41PM (#37079224)
Slightly related but sparsity-inducing activation function Relu is often used in neural networks
Re:Nvidia H100 GPUs: Supply and Demand on Tuesday August 01, 2023 @05:12AM (#36953998)
I don't remember the exact tweet, but here's one discussion [1]. I guess something changed in the mean time.

[1]_https://www.reddit.com/r/Amd/comments/140uct5/geohot_giving_...

Re:Nvidia H100 GPUs: Supply and Demand on Tuesday August 01, 2023 @03:50AM (#36953499)
Didn't they abandon development of AMD related software?
Re:Nobody cares about your blog on Saturday July 15, 2023 @11:44PM (#36743379)
Why did you start the blog? Was the reason to stand out or something else?
Re:Cosmic Skies of a Colorado July on Friday July 14, 2023 @08:07PM (#36731690)
To me the acceleration of the touchpad of macbooks feels unnatural, even after prolonged used. And this is coming from a linux user on an XPS. It's so rare to find this opinion being shared though.
Maybe OP doesn't travel a lot. Or is a taxi driver :)
That's an interesting morning routine. Why do you do so (do you work in 'measurement' industry?)?
Re:What Type of Exercise Is Best for Mental Health? on Sunday June 25, 2023 @09:23PM (#36474594)
Sorry to hear that. I guess you experienced major setbacks iN your life this year?
Looks great. Is this also coming to vscode? Also, the answer might be an obvious 'no', given a lack of features compared to vscode, but is it coming to pycharm?
Re:Ask HN: Are you tired of being fully remote? on Saturday June 24, 2023 @11:06AM (#36459307)
I'm an introvert but completely isolating from the team and having professional-only meetings is draining too draining for me.
Re:How to Do the Thing You've Been Avoiding on Thursday June 22, 2023 @01:57AM (#36428460)
Doesn't adhd just exacerbate the problem, but isn't the real cause? Like I will sometimes avoid some tasks because they highlight my insecurities
Re:JupyterLab 4.0 on Wednesday June 14, 2023 @09:05PM (#36335106)
I'll try then! Last I remember they had some weird variable loading policy: even under small cell executions there'd be noticable delay before variables got 'refreshed', even when lazy loading was configured. Maybe only a problem on my end though.

Older »