Re:Ray: A Distributed Framework for Emerging AI Applications
by ramoz on Monday July 05, 2021 @11:06AM
(#27738712)
CPU, GPU doesn't work out well in our case. There is the data transfer cost as well as memory constraint & the model blows up in memory for every inference call.
[ Parent
| on HN ]