moonmagick

Gary Marcus is a broken clock

He's been saying LLMs wouldn't scale since GPT-3 came out

And yet we all use them every day

Who cares about tracing? Prolog can't be multi-threaded on a GPU, why is that even in the conversation lol

I employ ~10 devs, and have hired quite a few over the last few years

I have no interest in looking at their resume, the first thing I do is look to see if they have a Github and what they've done with it

My green bar on Github and open source contributions have gotten me everything in life. Money, jobs, contracts, community support, etc.

Do people realize that there are hundreds of AI agents interacting with each other right now as a swarm on X?

This advice could probably apply to an interesting swath of new startups

Well, I can't think of a lot of well balanced people I know remotely at his level of success. I don't think that this is because successful people are imbalanced as much as I think most people are pretty imbalanced in some way, and successful people are just far more scrutinized. One of the worst oppressions on all of us is that we all have to carry some individual shame for something that probably happened to us as children, and it can't be talked about since it is so easily weaponized. There is no incentive to move toward a mentally healthier society in these conditions, I don't think. I'm open to a better way, but this feels like the dangerous parts of cancel culture, since it basically enables hackers to destroy anyone with their personal life.

Someone needs to say it. The way he is acting is vile.

Initially it had some real problems. large context window-- but you can only paste 4k tokens into the UI, for example. It never seemed like anyone at Google was using it. NotebookLM is a great interface, though, with some nice bells and whistles, and finally shows what Gemini is capable of. However, Opus still has the best long context retrieval with the least hallucination from what I've tried.

3.5 Sonnet is fast, and that is very meaningful to iteration speed, but I find for the level of complexity I throw at it, it strings together really bad solutions compared to the more wholistic solutions I can work through with Opus. I use Sonnet for general knowledge and small questions because it seems to do very well with shorter problems and is more up-to-date on libraries.

Statistically, this form of abuse is extremely common. Something like 2-5% of women who have a sibling are sexually abused by them. Sam would have also been a child at this time. My experience of this world, especially SF startup scene, is that most people are mentally ill in some way and some people are just better at hiding it. We can both accept that Sam's sister is a bit ill, this probably did happen, and we probably shouldn't punish adults for the actions of their child selves too harshly. Does that seem ethical and fair?

Yawn. I don't use Claude because the interface is good. I use it because Opus 3 is the best model anyone has ever created for long context coding, writing and retrieval. Give me a model that doesn't have polluted dataset to game MMLU scores, something that tangibly gives good results, and maybe I'll care again.

For now I only keep ChatGPT because it's better Google.

If the site has no users and it's just you, it's like $20/mo.

If you have enough traffic that your bill is > $1,000, put some time into switching.

But I can have my entire site deployed with CI/CD on Github to Vercel in less than an hour. If I'm doing client work, my clients can go preview new work immediately. I can test and build deployments on different branches and send test builds to stakeholders. It's got a lot to like and it ends up saving you a lot of money.

What is right for just starting out is rarely right for scaling up. Too many people wasting too much time on AWS instead of shipping their app first.

If it’s fully on GPU that should be tenable, regardless of browser or not