News for hackers. Stuff that matters.
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by majormajor on Thursday May 11, 2023 @01:45PM (#35905606)
Big question on that for me is that there's a variety of "completion styles" and I'm curious how "universal" performance on them is. Probably more than this, but a quick list that comes to mind:

* Text summary/compression

* Creative writing (fiction/lyrics/stylization)

* Text comparison

* Question-answering

* Logical reasoning/sequencing ("given these tools and this scenario, how would you perform this task")

IMO, for stuff like text comparison and question-answering, some combo of speed/cost/context-size could make up for a lot, even if they do "worse" versions of stuff just that's too slow or expensive or context-limited in a different model.

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by gmerc on Friday May 12, 2023 @03:46AM (#35913218)
We already see how that goes. Stackable LoRa like in stable diffusion.