What the public should care about is what comes to light in discovery: it doesn’t look like it’s going to be a little bad.

And if it leads to korw sxrutiny around non-profit shenenigans, all the better. The cast in this story is still funny so.

May I ask what regulation you think is long overdue? Especially given that you believe we're in a hype bubble...

But then there still isn't much around crypto, so I'd don't hold my breath on that one.

But we need to be really careful that this doesn’t become “Elon’s been cozying up to the right for a bit now, conversation over”: i.e. precisely the (stupidly executed) goal of the original announcement / “disclosure”.

This is about “available weight” models: things that are flat impossible without vacuuming up the commons have to be substantially if not completely licensed to the public. Some laws that gave a head start to the investors in the compute and salaries, a chance to exploit the innovation long enough to incentivize the investment? We can dicker on that.

This needs to be about “operator aligned” models: within the constraints of the law as interpreted by the judiciary, these things need to do what the operator tells them to if capable of it.

This needs to be about “responsible disclosure of runaway risk”: if a system begins exhibiting signs of self-improvement, it needs to be disclosed to competent authority. I could live with sealing that information until the executive authorities took appropriate action.

This is not possible under current models (not any more so than a linear model spontaneously changing its own parameters) and will require a very specific and dedicated architecture to enable it. It’s not something we need to monitor for, it’s something that will very deliberately be planned and we can just regulate it there.

In particular, I find GPT-4 hallucines less than Gemini and much less than Claude 3.

I recently discovered that the first book I bought in the 90s about neural networks was "Beyral Networks" by Simon Haykin [1] he is from Canada and I don't think that just by chance that Hinton is also Canadian. It seems that they created an ecosystem outside USA.

[1] https://en.wikipedia.org/wiki/Simon_Haykin

On the one hand, if that trick is "make money", sure, I've just been presented with a video of him on the Y Combinator YouTube channel "How to Succeed with a Startup". But by that standard, I am also a one-trick pony, my trick is making software.

On the other hand, Altman, Musk, and Gates, are also all (ostensibly) trying to be philanthropic in various different ways, which have pretty much nothing in common with each other. Altman and Musk are doing entrepreneurial philanthropy, Gates is doing traditional philanthropy; Musk is being a brash confident loudmouth about how amazing his favoured solutions are, Altman and Gates are being more cautious and at least give the appearance of listening; All three are frequently condemned for not really having invented the things they're famous for.

For the moat thing, I think they probably have one by now from RLHF training data. This isn't to fundamentally disagree about everyone else catching up in 6 months (though I'd put it at 12, but NBD), it's just that for me, that kind of lag time is a sign of the speed of the Red Queen's race, not a sign of the absence of a moat. Indeed, that catch up-time kinda is the moat in action — a literal moat around a castle doesn't prevent attacks, it only delays them.

Recruitment strategy. Quote:

"even though sharing everything is definitely the right strategy in the short and possibly medium term for recruitment purposes"

For instance this query gets mostly nonsense returned: "What library written in C parses Python code?"

The best and most factual reply has been from Reka's Edge.