spawarotti

I did not say that. People can still do math even if they are completely eclipsed by AI, just as they can still play chess.

In fact, it's an interesting question: Would humans distilling ideas from AI-generated proofs help AI prove more theorems, or would AI not care at all, with no human contribution being useful in advancing its mathematical capabilities?

I think math will go the way of biology. Biologists enjoy untangling the infinitely complex mechanisms of life, including the brain, and win Nobel Prizes for discoveries like "how water enters a cell," rather than "constructing the first-ever cell capable of absorbing water."

No biologist has ever complained, "Gee whiz, it's so unfortunate that we already have a brain to study. It's all so meaningless! It would be so much better if we had to construct the first-ever brain from scratch."

I think plenty of the most intelligent people eat meat, which means they are perfectly fine with harming less intelligent species just to enjoy a tastier meal. Also, I don't think many of the most intelligent people would be particularly concerned about disturbing a few ants if they were the only obstacle to economic activity. Intellect-wise, we will be less than ants to superhuman AI.

I am still curious: when is it acceptable to hope that something is actually going to work well enough when handed over to the government?

I am still curious: when is it acceptable to hope that something is actually going to work well enough when handed over to the government?

> is never followed up with a “yes, but …” (realistic evaluation of how politics actually works).

OK, but following this logic, shouldn't we disband the government altogether and have mafias rule us all?

When is it acceptable to hope that something is actually going to work well enough when handed over to the government?

There is at least one startup doing it already (I'm not affiliated with it in any way): https://promptless.ai/

Smartness and happiness are like test coverage.

If you are not smart or have no tests, you will not be happy.

If you are smart or have high test coverage, you may or may not be happy.

There are two types of people: those who do backups, and those who will do backups.

At this point AGENTS.md is a README.md with enough hype behind it to actually motivate people to populate it with contents. People were too lazy to write docs for other people, but funnily enough are ok with doing it for robots.

This situation reminds me a bit of ergonomic handles design. Designed for a few people, preferred by everyone.

And a related page, in the other direction: https://www.futuretimeline.net/

Very good online course on debugging: Software Debugging on Udacity by Andreas Zeller

https://www.udacity.com/course/debugging--cs259

Great advice. I follow it in my coding efforts and it has never failed me. Great book about this: Unit Testing Principles, Practices, and Patterns, Vladimir Khorikov, 2020

https://www.manning.com/books/unit-testing

How do you deal with serializing properties "by reference"? E.g., if 3 objects reference object "Foo", then Foo is serialized once instead of being duplicated in the json 3 times?

I am especially excited for the Smart ComboBox:

https://devblogs.microsoft.com/dotnet/introducing-dotnet-sma...

In general, I see the idea of semantic matching instead of textual matching as one of the great, pragmatic applications of the current technology.

Somewhat related fun application of this concept is this: https://neal.fun/infinite-craft/ (the combination outputs are generated by LLMs)

Jake, I just read the blog post you shared. I loved it. The message and the writing style.

Currently some programmers, and with time more, have to write, integrate and debug LLMs, hence for the programming to end, other LLMs would have to be able to do so, too. LLMs successfully modifying other LLMs is, like, singularity. In other words, the moment programming ends is the same moment we all are going to die.

From the page:

Describe your data up front and generate schemas, API specifications, client / server code, docs, and more.

With TypeSpec, remove the handwritten files that slow you down, and generate standards-compliant API schemas in seconds.

At a first glance this looks to me to be the same concept as "The Heptagon of Configuration":

https://matt-rickard.com/heptagon-of-configuration

Truer words have never been spoken.

Microsoft IntelliTest (formerly Pex) [1] is internally using Z3 constraint solver that traces program data and control flow graph well enough to be able to generate desired values to reach given statement of code. It can even run the program to figure out runtime values. Hence the technique is called Dynamic Symbolic Execution [3]. We have technology for this, just not yet applied correctly.

I would also like to be able to point at any function in my IDE and ask it:

- "Can you show me the usual runtime input/output pairs for this function?"

- "Can you show me the preconditions and postconditions this function obeys?"

There is plenty of research prototypes doing it (Whyline [4], Daikon [5], ...) but sadly, not a tool usable for the daily grind.

[1] https://learn.microsoft.com/en-us/visualstudio/test/intellit...

[2] https://link.springer.com/chapter/10.1007/978-3-642-38916-0_...

[3] https://queue.acm.org/detail.cfm?id=2094081

[4] https://www.cs.cmu.edu/~NatProg/whyline.html

[5] https://plse.cs.washington.edu/daikon/

> but what these people often need is someone to sit with them for a significant amount of time and demonstrate how one breaks a problem down, builds small pieces that demonstrate functionality and then put those pieces together into a solution.

And what if this is done repeatedly for the junior engineer, and yet any initiative they show after that is still negligible?

Thx, nice explanation. I think possibly Mercurial actually stores only the diffs, but I am not sure.

One generalization of this concept I see is: Instead of having a sequence of successive states, you only need the initial state and a function telling you how to compute the next state from previous one.

You can also see a connection to a version control system like Git. Instead of keeping snapshots of all the contents of the repository after each commit, one can keep only the initial repository state and changes in each commit. Then to get to N-th state you say "Apply first N commits to the initial state".

In the bouncing DVD logo example the "function to compute next state" or "commit contents" is just easy and regular, to the point of being expressible via simple math functions.

This is also known as Event Sourcing.

That's what I was thinking, too. Perhaps we already know majority of what there is to know, when it comes to fundamental concepts? Probably plenty of work left in improving our tools and engineering solutions, like machine learning-based software, as well as in understanding the intricates of biology. Maybe mathematics, too. Maybe improvements in these will cause another golden age of discovery. Like, understanding biology enough to gain significantly extended lifespan, which means much more expertise can be built by one individual.

According to [0] the toll of civilian deaths is 9% not ~90%:

> The 542 drone strikes that Obama authorized killed an estimated 3,797 people, including 324 civilians.

> I define a few test cases and the AI writes code for a generalized solution

How about the AI never writing any code, just training "mini AI" / network that implements the test cases, of course in a generalized way, the way our current AI systems work. We could continue adding test cases for corner cases until the "mini AI" is so good that we no longer can come up with a test case that trips it over.

In such future, the skill of being comprehensive tester would be everything, and the only code written by humans would be the test cases.

This situation reminds me of low-background steel:

Low-background steel, also known as pre-war steel, is any steel produced prior to the detonation of the first nuclear bombs in the 1940s and 1950s. Typically sourced from shipwrecks and other steel artifacts of this era, it is often used for modern particle detectors because more modern steel is contaminated with traces of nuclear fallout.

https://en.m.wikipedia.org/wiki/Low-background_steel

This article reminds me of "The Church of Interruption", the best short article I ever read about communication styles: https://sambleckley.com/writing/church-of-interruption.html