News for hackers. Stuff that matters.
Re:AI Is Already Killing Books by apwell23 on Saturday January 06, 2024 @10:37AM (#38892263)
> Current LLMs can not summarize books even if they are in their training set

Why is this? due to legal reasons?

Re:AI Is Already Killing Books by macilacilove on Saturday January 06, 2024 @11:30AM (#38892757)
Most importantly due to the context length not being long enough. If the context length was long enough, it is possible that they could do it with clever training. I only trained much smaller language models though.
Re:AI Is Already Killing Books by avandekleut on Saturday January 06, 2024 @11:13AM (#38892602)
The context windows aren’t large enough, as I understand it. It might be possible via a chain-of-summarization, though.