Re:The Problems That Attract the Smartest People
by wsgeorge on Monday April 03, 2023 @05:57AM
(#35420932)
On start up it does load a fraction of the weights, so RAM usage is low, but as you run inferences on the model, it tends to eat up the required amount of RAM. This was from my initial testing.
[ Parent
| on HN ]
There are no comments on this comment yet.