News for hackers. Stuff that matters.
Re:Show HN: Finetune LLaMA-7B on commodity GPUs using your o... by lxe on Wednesday March 22, 2023 @01:38AM (#35257230)
> How does the memory usage scale as the sequence length grows?

That's a good question. I was under the assumption it's linearly proportional, but I can test it out I guess.

Re:Show HN: Finetune LLaMA-7B on commodity GPUs using your o... by Taek on Wednesday March 22, 2023 @01:53AM (#35257320)
I suspect its linear with a small constant factor.