Re:Serving 70B-Scale LLMs Efficiently on Low-Resource Edge D...
by adunsulag on Thursday October 03, 2024 @02:52PM
(#41733704)
This is where I want highly sensitive healthcare consumers of LLMs to be at. Note summation, suggested diagnosis (provider always in control), and other augmented abilities for the clinical staff without the risk of health care data sent outside the device, or the very local network.
[ Parent
| on HN ]
There are no comments on this comment yet.