Re:Benchmarks show even an old Nvidia RTX 3090 is enough to ...
by washadjeffmad on Friday August 23, 2024 @09:03PM
(#41334640)
Capacity doesn't equate to quality, but I could easily see an 8B finetune with exl2 at low context working for short, simple customer interactions, akin to oversubscribing a 1Gbit uplink for 100 customers at 50Mbps.
[ Parent
| on HN ]
There are no comments on this comment yet.