quantumspandex

Science doesn't have to be a grind with AI.

No one "forces" anyone to verify it.

This reprioritization of math would release a tremendous amount of human capital to do other more productive things other than posing yet another abstract puzzle which may or may not have an use in a few hundred years. It's not even clear if the human race can survive until then nor is it justified to spend that resource researching that far ahead instead of just when we need it.

Yeah but we are not talking about what should be studied, but rather what should be funded

Let's just wait until the truth comes out to see how smug you were

How about not trying to be always on the cutting edge ? Is mathematics a sport ?

We don't train current LLMs to mimic the average human's writing style. We train it to be smart, helpful, and knowledgable, too knowledgeable for a human. We can easily train a LLM to pass the Turing test if we wanted to, but then it would just sound dumb or biased.

Stable environment for new hardware where everything works out of the box.

Computation on human brain is on a totally different substrate than silicon. It's in memory and highly error prone.

It's questionable a mere algorithm would get us there without a fundamental change in computer architecture. (in terms of Intelligence / W)

Security is another problem, and should be tackled systematically. Artificially making dependency inclusion hard is not it and is detrimental to the more casual use cases.

Watching on a movie on a 10 hour flight while not having to sit in awkward position for charging is one use case.

When you go travelling and do not want to carry around a backpack, and 1 day of heavy video recording, watching youtube on train plus 1 year of lithium battery degradation. That's when I want larger battery.

So we are paying 99% of the performance just for the 1% of cases where it's nice to code in.

Why do people think it's a good trade-off?

Law should be considered to be artificial rules optimized for the collective good of society.

What's the worst that can happen if we allow unregulated AI training on existing music? Musician as a job won't exist anymore lest for the greatest artists. But it makes creating music much more accessible to billions of people. Are they good music? Let the market decide. And people still make music because the creative process is enjoyable.

The animus towards AI generated music deeply stems from job security. I work in software and I see it is more likely that AI can be eventually able to replace software devs. I may lose my job if that happens. But I don't care. Find another career. Humanity needs to progress instead of stagnating for the sake of a few interest groups.

that's just your opinion.

Can humans generate a song based on custom lyrics and style in a matter of minutes?

AlphaGo seems more like an automated process to me because you can start from nothing except the algorithm and the rules. Since a Go game only has 2 outcomes most of the time, and the model can play with itself, it is guaranteed to learn something during self-play.

In the LLM case you have to have an already capable model to do RL. Also I feel like the problem selection part is important to make sure it's not too hard. So there's still much labor involved.

Will have a look. Thanks!

Thanks!

Andrej's video is great but the explanation on the RL part is a bit vague to me. How exactly do we train on the right answers? Do we collect the reasoning traces and train on them like supervised learning or do we compute some scores and use them as a loss function ? Isn't the reward then very sparse? What if LLMs can't generate any right answers cause the problems are too hard?

Also how can the training of LLMs be parallelized when updating parameters are sequential? Sure we can train on several samples simultaneously, but the parameter updates are with respect to the first step.

I get the opposite experience nowadays. Still having to debug random issues that are only on Linux.

As consumer-hostile as Microsoft's practices are, and that these things needs to be optional, I find linking your Windows to a Microsoft's account still pretty useful. With it you can sync your Windows settings across different devices. You can use Find My Device. You can save your BitLocker's encryption key to the cloud. It helps when you forgot your login password. Copilot AI stuffs,... Turning off telemetry and deinstalling some bloatware requires clicking through a few menus, but it's still a mostly just-work experience compared to the amount of time I need to set up a Linux box.

On Linux, configuring the fingerprint to work everywhere requires reading through different online threads and edit a config file. Enabling TPM auto disk decryption involves 10 steps command line. Enabling proprietary video codecs necessitates adding a third party repository. And many other small issues that I have to troubleshoot (shutdown freezing, sddm crashing after wake-up from sleep, PackageKit unable to update package, having to turn on a kernel flag for touchpad to work...). I really want Linux to work for me but still have to decide to use Windows on my personal laptop, coming from someone who has to work with Linux everyday at work.

You may look into Framework laptops.

Only if all you ever do is web browsing and do some light office work. As soon as you have to troubleshoot something or install some less popular software, you can't avoid it.

you are missing out then.

Nice write-up. I learned something new.. Thank you.

His point was type support and standard way of doing things. Using your argument we just need string type to represent everything.

I think a lot has happened between 1960 and 2020: smartphones, internet, machine learning, hubble telescope, internet of things, ecommerce ...

Going from personal computer of the 1960s to what we have today in our pocket is an enormous achievement in itself so it's a bit disingenuous to list it off as a single word "personal computer".

If we measure progress by whatever metrics: number of patents, number of scientific publication, ... in fact things are speeding up even more.