gok

This is yet another example of the incredible negative impact of Google’s pattern of crapping out open-source libraries without actually maintaining them, so that people just copy and paste them into their projects.

So... a classifier model?

"Arm-designed CPU core matches Apple-designed CPU core from a year ago"

It could probably go quite a bit faster using Arm SME. The entire network could fit into the ZA register.

New York State is funding Plattsburgh as an electric aviation R&D hub, and actually gave BETA $20M in a grant.

It's a fascinating design but it's been 14 years since the concept was first announced and it's never really completely worked. If it ever was possible, it's not clear the talent for it still works for SpaceX.

Ok that's...just cheating. You can't take a benchmark like MMLU designed to test the performance of a single general language model and compare it to performance of a small specialized model designed to do well on MMLU.

An HTML5 super jet?

consider using fp16 or bf16 for the matrix math (in SME you can use svmopa_za16_f16_m or svmopa_za16_bf16_m)

Do you use fully bidirectional attention or is it at all causal?

The oldest iBook G4 is from October 2003, not even 23 years old.

There are many marginally employable swing voters who vote Republican when they have jobs and the Democrats in charge ask for taxes, then vote Democratic when they get put out of work and need a social safety net.

> it is possible to put 500 to 1000 TW/year of AI satellites into deep space, meaningfully ascend the Kardashev scale and harness a non-trivial percentage of the Sun’s power

We currently make around 1 TW of photovoltaic cells per year, globally. The proposal here is to launch that much to space every 9 hours, complete with attached computers, continuously, from the moon.

edit: Also, this would capture a very trivial percentage of the Sun's power. A few trillionths per year.