News for hackers. Stuff that matters.
Re:Benchmarks show even an old Nvidia RTX 3090 is enough to ... by washadjeffmad on Friday August 23, 2024 @09:03PM (#41334640)
Capacity doesn't equate to quality, but I could easily see an 8B finetune with exl2 at low context working for short, simple customer interactions, akin to oversubscribing a 1Gbit uplink for 100 customers at 50Mbps.

There are no comments on this comment yet.