Ale is what makes this work locally, I felt a little conscious about it as I am not sure if it is a novel approach or somebody comes out and claims I rediscovered BERT or something (though ale runs at 1/10 the cost of BERT).
It either might be some neural engine like what Apple is doing and tensor units like what high end android phones already have or something dedicated.
Based on the current capacity issues around the globe, perhaps 1-5 years?
But we have for sure crossed a price point were you just might buy 10 ai credits and will be able to just play 100h without running ot of your ai credits. basic conversations etc. finetuned for a game, doesn't need a frontier model.
If the AI Bubble bursts a little and the inflated prices for tech dwindle down to normal maybe, otherwise, it will be too expensive.
Or some other advancement that challenges the giants financially but incentivizes companies to build for local AI usage.
I do wonder if this is an avenue for console gaming that might be practical in a few years; AI-centric hardware that might be too beefy or expensive for regular users, but can extend new or existing games. Kinda like the expansion paks of old.
unfortunate that the "ALE" design wasn't opensourced (couldn't find a link in their post) but I would be interested in learning more about the design, in particular what sort of data pipeline was necessary from skyrim to give this sort of action flexibility?