There are many ideas (society enhancing ones) that I have that I can't do due to context size being too low, inference being too slow, or price being too high.

For example, I want to use an LLM system to track every promise a politician makes ever and see if he or she actually did it. No one is going to give me $1 billion to do this. But I think it would enhance society.

I don't need an AGI to do this idea. I think current LLMs are already more than good enough. But LLM prices are still way to high to do this cost effectively. When inference is as cheap relatively as serving up a web page, LLMs will be ubiquitous.

Out of pure curiousity: do your really think that would make any significant difference for voter behavior? My understanding is that one of the biggest misunderstandings of the last decade+, was that center and leftist politicians assumed it would keep people from voting against their interests if you point out the lies of the relevant politicians and how their policies actually go against their voters interests. I mean that was the whole point of the fact-checking stuff gaining traction in mainstream-media during that time: just to be mostly abolished again because people are just not interested in truth and facts as much as we like to assume. Not not at all. But not as much as we tend to think.

Please don't get me wrong, I am not trying to be sarcastic here. I would love to see a perspective – just any perspective – of how to get out of the current political situation. Not just in the US but in many other countries the same playbook is followed by authoritarians with just as much success as in the US. So if you have material or some reasoning at hand why more information for the population would make a difference on the voting behaviour I would be super-interested. Thanks in advance!

I don't know if it will make any difference. But this sort of large scale data categorization is possible only with an LLM. Previously, you probably needed dozens of people working full time to do this. Now you just have a few GPUs do it.

I have a lot more ideas that are gated by low context size, inference speed, and price per token.

The bottomline is that we don't need AGI to change the world. Just more an cheaper compute.

I have been toying with idea to make candidate chooser on what members of parliament actually voted for. That data set is pretty limited and readily available. Just get the vote record and identify key bills. No LLM needed.

> Just get the vote record and identify key bills. No LLM needed.

How do you compare their vote record with the things they've said publicly?

> For example, I want to use an LLM system to track every promise a politician makes ever and see if he or she actually did it.

You're describing a list. Why do you need GPU farms to create a list?

How do you populate that list and verify the promises on the list?

You can't verify anything with a LLM.