logane
Show HN: A FlashAttention backwards-over-backwards pass
Show HN: Model-Aware Dataset Selection with Datamodels (DsDm)
Show HN: Tensorguard – Pretty runtime typechecking for PyTorch/NumPy tensors
Show HN: Go-links via GitHub Pages
Show HN: Gitlinks – Git powered golinks
Show HN: FFCV – Accelerated machine learning via fast data loading
In software we have a nice compilation process that transforms code into machine code. However, to "compile" an ASIC you go from a hardware description language like verilog (which basically describes the design) and pass it through a complicated pipeline that composes a number of different tools. Right now, engineers use ad-hoc flows that use bash/TCL to glue together all the parts --- the project posted above is an attempt to cleanly specify + control the "compilation" process.
For (a), maybe surprisingly the answer is mostly yes! Better ImageNet accuracy generally corresponds to better out of distribution accuracy. For (b), it turns out that the ImageNet dataset is full of contradictions---many images have multiple ImageNet-relevant objects, and often are ambiguously or mis-labeled, etc---so it's hard to disentangle progress in identifying objects vs. models overfitting to the quirks of the benchmark.
[1] ObjectNet: https://objectnet.dev / associated paper
[2] ImageNet-v2: https://arxiv.org/abs/1902.10811
[3] An Unbiased Lookat Dataset Bias: https://people.csail.mit.edu/torralba/publications/datasets_... (pre-AlexNet!)
[4] From ImageNet to Image Classification: https://arxiv.org/abs/2005.11295
[5] Are we done with ImageNet? https://arxiv.org/abs/2006.07159
[6] Evaluating Machine Accuracy on ImageNet: http://proceedings.mlr.press/v119/shankar20c.html
The mirror system isn't quite as macgyvered though :)
Do you have any evidence of this happening? I've never heard of pro-US censorship before on any of these platforms (or any social media platform..)
Identifying Statistical Bias in Dataset Replication
I've never viewed it as a potential full time job. However, I recently got GitHub sponsors and make about 5$ a month!
For the tech stack we used react on the front end with a Node.js server + Firebase for persistent storage. This was my first time writing Javascript in about 5-6 years and it's really neat to see how the ecosystem has matured - there are even real classes now! We also used the Google Cloud Vision API for detecting inappropriate images.
On the database side, we found that Firebase Store works really well until it doesn't -- when you want to do anything that isn't basic reads/writes (e.g. SQL-like IN queries, query pagination, programmatic queries like sorting by the HN ranking algorithm ~ points/(time since post)^(1.5)) the workarounds can get complex and a little weird.
One question we had is around AdSense approval! The Google Adsense approval team rejected our website for not having enough meaningful content / not having "valuable inventory" - it would be great to hear some insight about how to show Google we are a real website.
Happy to answer any questions here or at [email protected]!
Show HN: ZoomerBackgrounds – community-sourced virtual video backgrounds
It looks like this article works through something vaguely similar for $\ell_2$ adversarial examples. It would be interesting to compare the author's approach with explicit adversarial training.
Show HN: Robust-ML.org, a community-run reference for SOTA adversarial defenses
It seems that all current state of the art architectures are vulnerable to adversarial examples; to the best of my knowledge there are no image classification networks that researchers have failed to reliably produce adversarial examples for.