atobe
Small LM trained on Tiny Stories. My first goal was to get people to see tokens from the model ASAP, the second was to demo Tiny Stories for those who may be unfamiliar. Oh and play with ternary models. https://arxiv.org/abs/2305.07759
There's larger QA model on the same page too.
I'm curious whether folks think the ideas of LISP are still resonant and powerful in the startup world and wider industry.
This is different from the question of inspiration. Yes, I admire.
Does PG, for instance, still think that startups can have 'secret' technical advantages and use strategies like 'running upstairs', i.e. choosing to do hard things as a competitive advantage.
By ideas of LISP I mean things like programs-as-data and a small kernel from which the system is bootstrapped.
I think it's a great idea, btw.
Of all people BillG has actually been before congress and represented on this issue. He had said that Microsoft had often been naive with regard to the contact needed in Washington to get things changed.
Modernising this idea, how about Eric Schmidt?
Wasn't Patrick Naughton asked what Sun should do when he resigned?
Seems to be the new black - winning the mind share, losing the battle.