LarsDu88
Galactus the Devourer and the exponential time hypotheses
Amodei's academic background is relevant for protein engineering. Hence the recent press releases Anthropic has released which all concern prototype proof-of-concepts related to binding efficacy.
For a large number of therapeutic relevant indications, the bottleneck is actually clinical trials where you must contend with the sideeffects of any given therapeutic. Almost every drug I've worked on involves very well known mechanisms where knockdowns with targeted compounds will work in a petri dish, but can have catastrophic consequences when dosed on a live human.
As far as I can see there is no way to accelerate clinical trials in humans.
Even the most fantastically large and detailed perturbation datasets will struggle to capture this dynamic in a full human. This is why tech oligarchs are investing in virtual cell models. With a large automated research lab running perturbations 24/7 and capturing massive amounts of data, perhaps we will get as confident with predicting outcomes in cells as we now are confident with many coding projects. However, this is a scientific question, not a technological one. Public companies rarely give the people running them leeway to try and fail on big scientific question marks as opposed to well established or soon-to-be well established technology.
Getting IPO level monies should enable the amount of capital needed to sustain such efforts, and if I were a betting man, that is going to be Anthropic's actual endgame given their nascent efforts in automating bio research.
There are moonshot projects related to superconductors, materials, and biology that these companies can claim progress on to keep valuations stratospheric.
Allegedly he was extremely difficult to work with and would not share the Night's 3d game engine with an American team that was developing a 3d Sonic game for the Sega Saturn, effectively kneecapping a big part of that console's commercial viability
TLDR they suck and many default to doing probe rushes.
Nick is looking at a 32B model, which certainly has to compress less... Now we have 10 trillion parameter models... do they need to compress at all? As far as I can tell, experiments show that Fable has basically memorized every lat/long position on the map of the earth can can tell you at a glance whether your standing in the ocean or not based on your coordinates
Holding value is contingent on whether a company can manipulate the regulators to create a lasting monopoly or expand the market dramatically. My suspicion is that at some point the investors will gravitate towards the latter by turning LLMs into more active participants in the economy
First all the money went into the browsers like Mosaic then Netscape. Then the browser got commoditized, but that didn't mean the value went away. A better business model came along, and lo and behold, the Chrome browser went open source. The browser became free, and the scale of adoption meant a lot of value could still be extracted.
A free browser product didn't mean the value of Chrome went away. Rather the opposite. It's a gateway for buying stuff through Google search.
Marc Andressen was the "Mosaic browser" guy before he was the investor guy, so the folks in the early days did not lose all their money. Quite the opposite. Many are now billionaire oligarchs.
LLMs will likely go the way of the browser... commoditized, then free, then appropriated to shove ads into your face. I predict a lot of safety and interpretability research will be leveraged to one day push ads, just like "Golden Gate Claude" could be manipulated to think of itself as the Golden Gate Bridge.
Now Anthropic has migrated from Git to Scion. It's a good sign they are on the right track.
It's a simple manner of prompt...generate concept art with nanobanana, measure, llm creates svg with text, measure the distance between rasterized svg embedding to nanobanana art....do post-training RL on a 3 million such images and matching embeddings.
I swear this will be a canonical example of Goodhardt's Law in action.
You have to switch to a new benchmark that isn't so easy to run a verifiable rewards pipeline on...Perhaps a longer horizon task where it's easy to mess up midway.