simplegeek

Good article. As I reflect about it, I genuinely wonder (not in jest) whether pangram software uses AI to generate code? Secondly, what patterns do they look for in the text? Genuinely curious.

As an aside, for someone interested and who's an absolute beginner, can someone please recommend good resources on how to build LLMs from scratch? Thank you in advance.

For last few months, whenever I am trying to understand a difficult problem or a concept or addressing a complex issue at work or in relationships, I try to write one page by hand. Often it brings clarity or surfaces the core confusion/misunderstanding. I don't know why that works but it has been really useful.

I feel LLMs are indeed getting better at writing models. But, in my experience, they struggle to come up with correct safety and liveness properties unless you closely work with them. And of these two, they struggle the most with coming up with correct liveness properties.

Also for some problems I observe that models produced by LLMs often cause state space explosion. For simpler models they can fix this when you guide them though.

I’m sure LLMs will get even better.

That said, I take slightly different approach. Lamport said “ If you're thinking without writing, you only think you're thinking.” So taking that advice I always try to write the first draft with hand and once I have the final shape in place I then turn to an LLM for further exploration and experimentation if I have to.