Re:The LLama Effect: Leak Sparked a Series of Open Source Al...
by matthewdgreen on Sunday April 09, 2023 @05:46PM
(#35506783)
Is it hard to spin up an appropriate EC2 instance with 64GB+ of additional RAM? The m6a.8xlarge seems to have 128GB and costs $1.38 per hour. Was going to try this myself, but now I'm wondering if even that won't be worth the trouble. (I know this is not "your own devices" but would give a feel for what you're missing with the smaller models.)
[ Parent
| on HN ]